2024-02-19T21:35:35.287 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-19T21:35:35.287 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi --description fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/centos_latest} --verbose --archive /home/teuthworker/archive/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi/7566784 -- /home/teuthworker/archive/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi/7566784/orig.config.yaml 2024-02-19T21:35:35.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T21:35:35.392 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi/7566784 branch: pacific-release description: fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/centos_latest} email: null first_in_suite: false job_id: '7566784' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: pacific-release ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: pacific-release sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - host.b - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 9538 sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: pacific-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 targets: smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGxv3unWLzaPNAWxEEb71WIhMAQSIVJXpgmmLE/SY2J9Nw9Ht1UO7kv5Nsg9ECCWd31MZo10hhL07xRd4QMIdbs= smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFygB8ONx/qD4OYEDspSOMoLbhEmXaLetNhgh3HA810oWq9V2OZo+5ITjZY/bwkSh64S4dxPAYCaE4sIwPgoslc= tasks: - install: null - cephadm: roleless: true - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create foo - ceph fs volume create bar - fs.ready: timeout: 300 - ceph-fuse: client.0: cephfs_name: foo - ceph-fuse: client.1: cephfs_name: bar - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-19_19:27:49 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-19T21:35:35.393 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa; will attempt to use it 2024-02-19T21:35:35.393 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa/tasks 2024-02-19T21:35:35.393 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-19T21:35:35.395 INFO:teuthology.task.internal:Checking packages... 2024-02-19T21:35:35.419 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '81bd20d634209c7cb82c18be12b4b5a05643ebf1' 2024-02-19T21:35:35.419 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-19T21:35:35.419 INFO:teuthology.packaging:ref: None 2024-02-19T21:35:35.419 INFO:teuthology.packaging:tag: None 2024-02-19T21:35:35.419 INFO:teuthology.packaging:branch: pacific-release 2024-02-19T21:35:35.419 INFO:teuthology.packaging:sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:35:35.420 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific-release 2024-02-19T21:35:35.641 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-548.g81bd20d6 2024-02-19T21:35:35.643 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-19T21:35:35.649 INFO:teuthology.task.internal:no buildpackages task found 2024-02-19T21:35:35.650 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-19T21:35:35.672 INFO:teuthology.task.internal:Saving configuration 2024-02-19T21:35:35.682 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-19T21:35:35.688 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-19T21:35:35.712 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi/7566784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 21:30:35.563985', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGxv3unWLzaPNAWxEEb71WIhMAQSIVJXpgmmLE/SY2J9Nw9Ht1UO7kv5Nsg9ECCWd31MZo10hhL07xRd4QMIdbs='} 2024-02-19T21:35:35.734 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi/7566784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 21:30:35.562533', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFygB8ONx/qD4OYEDspSOMoLbhEmXaLetNhgh3HA810oWq9V2OZo+5ITjZY/bwkSh64S4dxPAYCaE4sIwPgoslc='} 2024-02-19T21:35:35.735 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-19T21:35:35.743 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-02-19T21:35:35.743 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-02-19T21:35:35.743 INFO:teuthology.run_tasks:Running task console_log... 2024-02-19T21:35:35.812 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f158051de50>, signals=[15]) 2024-02-19T21:35:35.812 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-19T21:35:35.819 INFO:teuthology.task.internal:Opening connections... 2024-02-19T21:35:35.819 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-02-19T21:35:35.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:35:35.897 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-02-19T21:35:35.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:35:35.968 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-19T21:35:35.975 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-02-19T21:35:35.997 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-02-19T21:35:35.997 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-02-19T21:35:36.058 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-02-19T21:35:36.058 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2024-02-19T21:35:36.058 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-02-19T21:35:36.058 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-02-19T21:35:36.058 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2024-02-19T21:35:36.058 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2024-02-19T21:35:36.058 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-19T21:35:36.059 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-02-19T21:35:36.059 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-19T21:35:36.059 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-02-19T21:35:36.059 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T21:35:36.059 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-19T21:35:36.059 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T21:35:36.059 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-02-19T21:35:36.089 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-02-19T21:35:36.111 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-02-19T21:35:36.111 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-02-19T21:35:36.172 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-02-19T21:35:36.172 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8" 2024-02-19T21:35:36.173 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-02-19T21:35:36.173 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-02-19T21:35:36.173 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8" 2024-02-19T21:35:36.173 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2024-02-19T21:35:36.173 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-19T21:35:36.173 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-02-19T21:35:36.173 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-19T21:35:36.173 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-02-19T21:35:36.173 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T21:35:36.173 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-19T21:35:36.173 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T21:35:36.173 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-02-19T21:35:36.196 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-19T21:35:36.205 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-19T21:35:36.211 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-19T21:35:36.211 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-02-19T21:35:36.213 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-02-19T21:35:36.234 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-19T21:35:36.240 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-19T21:35:36.240 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-02-19T21:35:36.273 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-02-19T21:35:36.306 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-19T21:35:36.358 INFO:teuthology.run_tasks:Running task kernel... 2024-02-19T21:35:36.373 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-19T21:35:36.373 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-19T21:35:36.373 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-19T21:35:36.374 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-19T21:35:36.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T21:35:36.394 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-02-19T21:35:36.394 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T21:35:36.395 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-02-19T21:35:36.454 INFO:teuthology.orchestra.run.smithi099.stdout:4.18.0-489.el8.x86_64 2024-02-19T21:35:36.454 INFO:teuthology.task.kernel:Running kernel on smithi099: 4.18.0-489.el8.x86_64 2024-02-19T21:35:36.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum install -y kernel 2024-02-19T21:35:36.456 INFO:teuthology.orchestra.run.smithi138.stdout:4.18.0-489.el8.x86_64 2024-02-19T21:35:36.456 INFO:teuthology.task.kernel:Running kernel on smithi138: 4.18.0-489.el8.x86_64 2024-02-19T21:35:36.457 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum install -y kernel 2024-02-19T21:35:53.728 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 8 - AppStream 1.9 MB/s | 27 MB 00:14 2024-02-19T21:35:54.172 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - AppStream 1.8 MB/s | 27 MB 00:15 2024-02-19T21:35:59.253 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 10 MB 00:00 2024-02-19T21:35:59.492 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 10 MB 00:00 2024-02-19T21:36:01.137 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 8 - Extras 60 kB/s | 18 kB 00:00 2024-02-19T21:36:01.218 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - Extras 153 kB/s | 18 kB 00:00 2024-02-19T21:36:01.387 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 8 - Extras common packages 49 kB/s | 6.9 kB 00:00 2024-02-19T21:36:01.627 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - Extras common packages 23 kB/s | 6.9 kB 00:00 2024-02-19T21:36:01.672 INFO:teuthology.orchestra.run.smithi138.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2024-02-19T21:36:01.920 INFO:teuthology.orchestra.run.smithi099.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2024-02-19T21:36:03.488 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-02-19T21:36:03.743 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 8.2 MB/s | 16 MB 00:01 2024-02-19T21:36:07.254 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 378 kB/s | 24 kB 00:00 2024-02-19T21:36:07.482 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 332 kB/s | 24 kB 00:00 2024-02-19T21:36:10.267 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-19T21:36:10.267 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-19T21:36:10.385 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:36:10.386 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:36:10.386 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-02-19T21:36:10.386 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:36:10.386 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:36:10.386 INFO:teuthology.orchestra.run.smithi099.stdout: kernel x86_64 4.18.0-539.el8 baseos 10 M 2024-02-19T21:36:10.386 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-02-19T21:36:10.386 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core x86_64 4.18.0-539.el8 baseos 43 M 2024-02-19T21:36:10.387 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules x86_64 4.18.0-539.el8 baseos 36 M 2024-02-19T21:36:10.387 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:36:10.387 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:36:10.387 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:36:10.387 INFO:teuthology.orchestra.run.smithi099.stdout:Install 3 Packages 2024-02-19T21:36:10.387 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:36:10.387 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 90 M 2024-02-19T21:36:10.387 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 97 M 2024-02-19T21:36:10.388 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:36:10.462 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-19T21:36:10.462 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-19T21:36:10.578 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:36:10.579 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:36:10.579 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-02-19T21:36:10.579 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:36:10.579 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:36:10.579 INFO:teuthology.orchestra.run.smithi138.stdout: kernel x86_64 4.18.0-539.el8 baseos 10 M 2024-02-19T21:36:10.579 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-19T21:36:10.579 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-core x86_64 4.18.0-539.el8 baseos 43 M 2024-02-19T21:36:10.579 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules x86_64 4.18.0-539.el8 baseos 36 M 2024-02-19T21:36:10.579 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:36:10.579 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:36:10.579 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:36:10.579 INFO:teuthology.orchestra.run.smithi138.stdout:Install 3 Packages 2024-02-19T21:36:10.580 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:36:10.580 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 90 M 2024-02-19T21:36:10.580 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 97 M 2024-02-19T21:36:10.580 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:36:11.564 INFO:teuthology.orchestra.run.smithi099.stdout:(1/3): kernel-4.18.0-539.el8.x86_64.rpm 9.1 MB/s | 10 MB 00:01 2024-02-19T21:36:12.216 INFO:teuthology.orchestra.run.smithi138.stdout:(1/3): kernel-4.18.0-539.el8.x86_64.rpm 7.1 MB/s | 10 MB 00:01 2024-02-19T21:36:14.063 INFO:teuthology.orchestra.run.smithi099.stdout:(2/3): kernel-modules-4.18.0-539.el8.x86_64.rpm 9.9 MB/s | 36 MB 00:03 2024-02-19T21:36:14.467 INFO:teuthology.orchestra.run.smithi138.stdout:(2/3): kernel-modules-4.18.0-539.el8.x86_64.rpm 9.8 MB/s | 36 MB 00:03 2024-02-19T21:36:14.739 INFO:teuthology.orchestra.run.smithi099.stdout:(3/3): kernel-core-4.18.0-539.el8.x86_64.rpm 10 MB/s | 43 MB 00:04 2024-02-19T21:36:14.739 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:36:14.739 INFO:teuthology.orchestra.run.smithi099.stdout:Total 21 MB/s | 90 MB 00:04 2024-02-19T21:36:15.050 INFO:teuthology.orchestra.run.smithi138.stdout:(3/3): kernel-core-4.18.0-539.el8.x86_64.rpm 10 MB/s | 43 MB 00:04 2024-02-19T21:36:15.051 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:36:15.051 INFO:teuthology.orchestra.run.smithi138.stdout:Total 20 MB/s | 90 MB 00:04 2024-02-19T21:36:15.419 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:36:15.735 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:36:15.844 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:36:15.844 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:36:16.142 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:36:16.142 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:36:17.076 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:36:17.102 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:36:17.392 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:36:17.422 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:36:19.875 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:36:20.172 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:36:20.378 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-19T21:36:20.728 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-19T21:36:23.973 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-19T21:36:24.289 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-19T21:36:24.370 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-19T21:36:24.694 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-19T21:36:27.811 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-19T21:36:28.129 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-19T21:36:28.135 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:36:28.452 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:36:50.009 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:36:50.033 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:36:50.332 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:36:50.355 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:36:50.381 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:36:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-4.18.0-539.el8.x86_64 1/3 2024-02-19T21:36:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-core-4.18.0-539.el8.x86_64 2/3 2024-02-19T21:36:50.705 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:36:50.705 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-4.18.0-539.el8.x86_64 1/3 2024-02-19T21:36:50.705 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-core-4.18.0-539.el8.x86_64 2/3 2024-02-19T21:36:50.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:36:50.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:36:50.881 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:36:50.881 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-4.18.0-539.el8.x86_64 kernel-core-4.18.0-539.el8.x86_64 2024-02-19T21:36:50.881 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-4.18.0-539.el8.x86_64 2024-02-19T21:36:50.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:36:50.881 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:36:51.037 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T21:36:51.252 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-19T21:36:51.252 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-19T21:36:51.252 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-539.el8.x86_64 2024-02-19T21:36:51.252 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-19T21:36:51.252 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-19T21:36:51.253 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-02-19T21:36:51.253 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2024-02-19T21:36:51.253 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T21:36:51.463 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-19T21:36:51.463 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-19T21:36:51.463 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -qi grub2-tools 2024-02-19T21:36:51.466 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-19T21:36:51.467 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:36:51.467 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:36:51.467 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-4.18.0-539.el8.x86_64 kernel-core-4.18.0-539.el8.x86_64 2024-02-19T21:36:51.467 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-4.18.0-539.el8.x86_64 2024-02-19T21:36:51.467 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:36:51.467 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:36:51.497 INFO:teuthology.orchestra.run.smithi099.stdout:Name : grub2-tools 2024-02-19T21:36:51.497 INFO:teuthology.orchestra.run.smithi099.stdout:Epoch : 1 2024-02-19T21:36:51.497 INFO:teuthology.orchestra.run.smithi099.stdout:Version : 2.02 2024-02-19T21:36:51.497 INFO:teuthology.orchestra.run.smithi099.stdout:Release : 129.el8 2024-02-19T21:36:51.497 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: x86_64 2024-02-19T21:36:51.497 INFO:teuthology.orchestra.run.smithi099.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-19T21:36:51.497 INFO:teuthology.orchestra.run.smithi099.stdout:Group : System Environment/Base 2024-02-19T21:36:51.497 INFO:teuthology.orchestra.run.smithi099.stdout:Size : 9265586 2024-02-19T21:36:51.497 INFO:teuthology.orchestra.run.smithi099.stdout:License : GPLv3+ 2024-02-19T21:36:51.497 INFO:teuthology.orchestra.run.smithi099.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-19T21:36:51.498 INFO:teuthology.orchestra.run.smithi099.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-19T21:36:51.498 INFO:teuthology.orchestra.run.smithi099.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-19T21:36:51.498 INFO:teuthology.orchestra.run.smithi099.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-19T21:36:51.498 INFO:teuthology.orchestra.run.smithi099.stdout:Relocations : (not relocatable) 2024-02-19T21:36:51.498 INFO:teuthology.orchestra.run.smithi099.stdout:Packager : CentOS BuildSystem 2024-02-19T21:36:51.498 INFO:teuthology.orchestra.run.smithi099.stdout:Vendor : CentOS 2024-02-19T21:36:51.498 INFO:teuthology.orchestra.run.smithi099.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-19T21:36:51.498 INFO:teuthology.orchestra.run.smithi099.stdout:Summary : Support tools for GRUB. 2024-02-19T21:36:51.498 INFO:teuthology.orchestra.run.smithi099.stdout:Description : 2024-02-19T21:36:51.498 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:36:51.498 INFO:teuthology.orchestra.run.smithi099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-19T21:36:51.498 INFO:teuthology.orchestra.run.smithi099.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-19T21:36:51.498 INFO:teuthology.orchestra.run.smithi099.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-19T21:36:51.498 INFO:teuthology.orchestra.run.smithi099.stdout:hardware devices. 2024-02-19T21:36:51.499 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:36:51.499 INFO:teuthology.orchestra.run.smithi099.stdout:This subpackage provides tools for support of all platforms. 2024-02-19T21:36:51.499 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-19T21:36:51.500 INFO:teuthology.task.kernel:Updating grub on smithi099 to boot 4.18.0-539.el8.x86_64 2024-02-19T21:36:51.500 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-19T21:36:51.600 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T21:36:51.821 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-19T21:36:51.821 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-19T21:36:51.821 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-539.el8.x86_64 2024-02-19T21:36:51.821 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-19T21:36:51.821 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-19T21:36:51.821 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-02-19T21:36:51.821 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro) 2024-02-19T21:36:51.822 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T21:36:52.032 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-19T21:36:52.032 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-19T21:36:52.032 DEBUG:teuthology.orchestra.run.smithi138:> sudo rpm -qi grub2-tools 2024-02-19T21:36:52.066 INFO:teuthology.orchestra.run.smithi138.stdout:Name : grub2-tools 2024-02-19T21:36:52.066 INFO:teuthology.orchestra.run.smithi138.stdout:Epoch : 1 2024-02-19T21:36:52.066 INFO:teuthology.orchestra.run.smithi138.stdout:Version : 2.02 2024-02-19T21:36:52.066 INFO:teuthology.orchestra.run.smithi138.stdout:Release : 129.el8 2024-02-19T21:36:52.066 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: x86_64 2024-02-19T21:36:52.066 INFO:teuthology.orchestra.run.smithi138.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-19T21:36:52.066 INFO:teuthology.orchestra.run.smithi138.stdout:Group : System Environment/Base 2024-02-19T21:36:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:Size : 9265586 2024-02-19T21:36:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:License : GPLv3+ 2024-02-19T21:36:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-19T21:36:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-19T21:36:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-19T21:36:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-19T21:36:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:Relocations : (not relocatable) 2024-02-19T21:36:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:Packager : CentOS BuildSystem 2024-02-19T21:36:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:Vendor : CentOS 2024-02-19T21:36:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-19T21:36:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:Summary : Support tools for GRUB. 2024-02-19T21:36:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:Description : 2024-02-19T21:36:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:36:52.068 INFO:teuthology.orchestra.run.smithi138.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-19T21:36:52.068 INFO:teuthology.orchestra.run.smithi138.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-19T21:36:52.068 INFO:teuthology.orchestra.run.smithi138.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-19T21:36:52.068 INFO:teuthology.orchestra.run.smithi138.stdout:hardware devices. 2024-02-19T21:36:52.068 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:36:52.068 INFO:teuthology.orchestra.run.smithi138.stdout:This subpackage provides tools for support of all platforms. 2024-02-19T21:36:52.069 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-19T21:36:52.069 INFO:teuthology.task.kernel:Updating grub on smithi138 to boot 4.18.0-539.el8.x86_64 2024-02-19T21:36:52.069 DEBUG:teuthology.orchestra.run.smithi138:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-19T21:36:53.312 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-02-19T21:36:53.737 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-02-19T21:36:55.271 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-02-19T21:36:55.273 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-02-19T21:36:55.307 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.SRdiZm4Vqr 2024-02-19T21:36:55.308 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SRdiZm4Vqr 2024-02-19T21:36:55.382 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.SRdiZm4Vqr 2024-02-19T21:36:55.530 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.SRdiZm4Vqr is 6KB 2024-02-19T21:36:55.578 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.SRdiZm4Vqr 2024-02-19T21:36:55.594 DEBUG:teuthology.orchestra.run.smithi099:> sudo /bin/ls /boot/loader/entries || true 2024-02-19T21:36:55.638 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-02-19T21:36:55.638 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-02-19T21:36:55.668 INFO:teuthology.orchestra.run.smithi099.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-19T21:36:55.669 INFO:teuthology.orchestra.run.smithi099.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-19T21:36:55.669 INFO:teuthology.orchestra.run.smithi099.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-19T21:36:55.669 INFO:teuthology.orchestra.run.smithi099.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64.conf 2024-02-19T21:36:55.670 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64 2024-02-19T21:36:55.678 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.GoaIcLH8JT 2024-02-19T21:36:55.678 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GoaIcLH8JT 2024-02-19T21:36:55.750 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.GoaIcLH8JT 2024-02-19T21:36:55.827 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-02-19T21:36:55.900 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.GoaIcLH8JT is 6KB 2024-02-19T21:36:55.948 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.GoaIcLH8JT 2024-02-19T21:36:55.965 DEBUG:teuthology.orchestra.run.smithi138:> sudo /bin/ls /boot/loader/entries || true 2024-02-19T21:36:56.030 INFO:teuthology.orchestra.run.smithi138.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-19T21:36:56.030 INFO:teuthology.orchestra.run.smithi138.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-19T21:36:56.030 INFO:teuthology.orchestra.run.smithi138.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-19T21:36:56.030 INFO:teuthology.orchestra.run.smithi138.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64.conf 2024-02-19T21:36:56.031 DEBUG:teuthology.orchestra.run.smithi138:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64 2024-02-19T21:36:56.189 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2024-02-19T21:37:25.856 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-19T21:37:25.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-19T21:37:25.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:37:26.192 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-19T21:37:26.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-19T21:37:26.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:38:25.916 DEBUG:teuthology.orchestra.remote:timed out 2024-02-19T21:38:26.197 DEBUG:teuthology.orchestra.remote:timed out 2024-02-19T21:38:34.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-19T21:38:34.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:38:35.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-19T21:38:35.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:38:35.287 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-02-19T21:38:35.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-19T21:38:35.502 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-539.el8.x86_64"... 2024-02-19T21:38:35.502 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-02-19T21:38:35.519 INFO:teuthology.orchestra.run.smithi099.stdout:4.18.0-539.el8.x86_64 2024-02-19T21:38:35.519 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-539.el8.x86_64 vs 4.18.0-539.el8.x86_64 2024-02-19T21:38:35.519 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-19T21:38:35.519 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-19T21:38:35.719 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-02-19T21:38:36.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-19T21:38:36.002 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-539.el8.x86_64"... 2024-02-19T21:38:36.002 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-02-19T21:38:36.019 INFO:teuthology.orchestra.run.smithi138.stdout:4.18.0-539.el8.x86_64 2024-02-19T21:38:36.019 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-539.el8.x86_64 vs 4.18.0-539.el8.x86_64 2024-02-19T21:38:36.019 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-19T21:38:36.019 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-19T21:38:36.520 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-19T21:38:36.520 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-19T21:38:36.590 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2024-02-19T21:38:36.602 DEBUG:teuthology.parallel:result is None 2024-02-19T21:38:37.020 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-19T21:38:37.020 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-19T21:38:37.103 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2024-02-19T21:38:37.116 DEBUG:teuthology.parallel:result is None 2024-02-19T21:38:37.116 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-19T21:38:37.125 INFO:teuthology.task.internal:Creating test directory... 2024-02-19T21:38:37.126 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-19T21:38:37.128 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-19T21:38:37.145 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-19T21:38:37.152 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-19T21:38:37.158 INFO:teuthology.task.internal:Creating archive directory... 2024-02-19T21:38:37.159 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-19T21:38:37.187 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-19T21:38:37.209 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-19T21:38:37.216 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-19T21:38:37.216 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-19T21:38:37.245 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-19T21:38:37.273 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T21:38:37.280 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T21:38:37.284 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T21:38:37.290 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T21:38:37.291 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-19T21:38:37.298 INFO:teuthology.task.internal:Configuring sudo... 2024-02-19T21:38:37.298 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-19T21:38:37.335 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-19T21:38:37.363 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-19T21:38:37.371 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-19T21:38:37.372 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-19T21:38:37.406 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-19T21:38:37.423 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T21:38:37.508 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T21:38:37.566 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T21:38:37.651 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T21:38:37.698 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:38:37.698 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-19T21:38:37.767 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T21:38:37.813 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T21:38:37.854 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T21:38:37.934 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T21:38:37.986 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-19T21:38:37.986 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-19T21:38:38.049 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-02-19T21:38:38.051 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-02-19T21:38:38.108 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T21:38:38.155 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T21:38:38.424 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-19T21:38:38.432 INFO:teuthology.task.internal:Starting timer... 2024-02-19T21:38:38.432 INFO:teuthology.run_tasks:Running task pcp... 2024-02-19T21:38:38.442 INFO:teuthology.run_tasks:Running task selinux... 2024-02-19T21:38:38.451 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-19T21:38:38.452 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2024-02-19T21:38:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2024-02-19T21:38:38.522 DEBUG:teuthology.orchestra.run.smithi138:> sudo service auditd rotate 2024-02-19T21:38:38.816 INFO:teuthology.orchestra.run.smithi138.stdout:Rotating logs: 2024-02-19T21:38:38.842 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-19T21:38:38.842 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2024-02-19T21:38:38.868 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2024-02-19T21:38:38.868 DEBUG:teuthology.orchestra.run.smithi138:> /usr/sbin/getenforce 2024-02-19T21:38:39.356 INFO:teuthology.orchestra.run.smithi138.stdout:Permissive 2024-02-19T21:38:39.357 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi099.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi138.front.sepia.ceph.com': 'permissive'} 2024-02-19T21:38:39.357 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T21:38:39.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T21:38:39.385 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T21:38:39.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T21:38:39.828 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-19T21:38:39.829 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2024-02-19T21:38:39.877 DEBUG:teuthology.orchestra.run.smithi138:> sudo /usr/sbin/setenforce permissive 2024-02-19T21:38:40.232 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-19T21:38:40.243 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-19T21:38:40.260 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-19T21:38:40.261 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi099.front.sepia.ceph.com,smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-19T21:44:36.466 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2024-02-19T21:44:36.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-19T21:44:36.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:44:36.544 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-02-19T21:44:36.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-19T21:44:36.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-19T21:44:36.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T21:44:36.641 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-02-19T21:44:36.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-19T21:44:36.709 INFO:teuthology.run_tasks:Running task clock... 2024-02-19T21:44:36.720 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-19T21:44:36.720 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-19T21:44:36.721 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T21:44:36.723 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-19T21:44:36.723 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T21:44:36.752 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-19T21:44:36.766 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-19T21:44:36.780 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-19T21:44:36.794 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-19T21:44:36.833 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2024-02-19T21:44:36.845 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2024-02-19T21:44:36.858 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-19T21:44:36.871 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-19T21:44:36.875 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: ntpd: command not found 2024-02-19T21:44:36.887 INFO:teuthology.orchestra.run.smithi138.stdout:506 Cannot talk to daemon 2024-02-19T21:44:36.901 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-19T21:44:36.914 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-19T21:44:36.936 INFO:teuthology.orchestra.run.smithi099.stderr:bash: ntpq: command not found 2024-02-19T21:44:36.939 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T21:44:36.940 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-02-19T21:44:36.940 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:44:36.940 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:44:36.940 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:44:36.940 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:44:36.985 INFO:teuthology.orchestra.run.smithi138.stderr:bash: ntpq: command not found 2024-02-19T21:44:36.988 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T21:44:36.988 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-02-19T21:44:36.989 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:44:36.989 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:44:36.989 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:44:36.989 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T21:44:36.990 INFO:teuthology.run_tasks:Running task install... 2024-02-19T21:44:37.001 DEBUG:teuthology.task.install:project ceph 2024-02-19T21:44:37.001 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '81bd20d634209c7cb82c18be12b4b5a05643ebf1'}} 2024-02-19T21:44:37.001 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '81bd20d634209c7cb82c18be12b4b5a05643ebf1'} 2024-02-19T21:44:37.001 INFO:teuthology.task.install:Using flavor: default 2024-02-19T21:44:37.008 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-19T21:44:37.009 INFO:teuthology.task.install:extra packages: [] 2024-02-19T21:44:37.009 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81bd20d634209c7cb82c18be12b4b5a05643ebf1', 'tag': None, 'wait_for_package': False} 2024-02-19T21:44:37.009 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:44:37.012 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81bd20d634209c7cb82c18be12b4b5a05643ebf1', 'tag': None, 'wait_for_package': False} 2024-02-19T21:44:37.012 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:44:37.161 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/ 2024-02-19T21:44:37.161 INFO:teuthology.task.install.rpm:Package version is 16.2.14-548.g81bd20d6 2024-02-19T21:44:37.165 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/ 2024-02-19T21:44:37.165 INFO:teuthology.task.install.rpm:Package version is 16.2.14-548.g81bd20d6 2024-02-19T21:44:37.337 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-19T21:44:37.338 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:44:37.338 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-19T21:44:37.355 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/81bd20d634209c7cb82c18be12b4b5a05643ebf1/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-19T21:44:37.355 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-19T21:44:37.355 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-19T21:44:37.366 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-19T21:44:37.366 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81bd20d634209c7cb82c18be12b4b5a05643ebf1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-19T21:44:37.383 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-19T21:44:37.384 DEBUG:teuthology.orchestra.run.smithi138:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81bd20d634209c7cb82c18be12b4b5a05643ebf1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-19T21:44:37.435 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-19T21:44:37.451 DEBUG:teuthology.orchestra.run.smithi138:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-19T21:44:37.511 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-19T21:44:37.528 DEBUG:teuthology.orchestra.run.smithi138:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-19T21:44:37.577 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2024-02-19T21:44:37.578 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2024-02-19T21:44:37.594 INFO:teuthology.orchestra.run.smithi138.stdout:check_obsoletes = 1 2024-02-19T21:44:37.595 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum clean all 2024-02-19T21:44:37.847 INFO:teuthology.orchestra.run.smithi099.stdout:76 files removed 2024-02-19T21:44:37.864 INFO:teuthology.orchestra.run.smithi138.stdout:76 files removed 2024-02-19T21:44:37.874 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw 2024-02-19T21:44:37.891 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-radosgw 2024-02-19T21:44:38.617 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 224 kB/s | 76 kB 00:00 2024-02-19T21:44:38.745 INFO:teuthology.orchestra.run.smithi138.stdout:ceph packages for x86_64 172 kB/s | 76 kB 00:00 2024-02-19T21:44:38.917 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 58 kB/s | 15 kB 00:00 2024-02-19T21:44:39.137 INFO:teuthology.orchestra.run.smithi138.stdout:ceph noarch packages 43 kB/s | 15 kB 00:00 2024-02-19T21:44:39.277 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 4.4 kB/s | 1.4 kB 00:00 2024-02-19T21:44:39.463 INFO:teuthology.orchestra.run.smithi138.stdout:ceph source packages 4.9 kB/s | 1.4 kB 00:00 2024-02-19T21:44:59.063 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 8 - AppStream 1.4 MB/s | 27 MB 00:19 2024-02-19T21:45:01.283 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - AppStream 1.2 MB/s | 27 MB 00:21 2024-02-19T21:45:04.522 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 10 MB 00:00 2024-02-19T21:45:06.397 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 8 - Extras 61 kB/s | 18 kB 00:00 2024-02-19T21:45:06.693 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 10 MB 00:00 2024-02-19T21:45:09.023 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 8 - Extras common packages 2.8 kB/s | 6.9 kB 00:02 2024-02-19T21:45:10.018 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - Extras 10 kB/s | 18 kB 00:01 2024-02-19T21:45:10.158 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 8 - PowerTools 4.7 MB/s | 4.8 MB 00:01 2024-02-19T21:45:10.410 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - Extras common packages 25 kB/s | 6.9 kB 00:00 2024-02-19T21:45:11.226 INFO:teuthology.orchestra.run.smithi138.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-02-19T21:45:11.536 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 8 - PowerTools 4.7 MB/s | 4.8 MB 00:01 2024-02-19T21:45:12.579 INFO:teuthology.orchestra.run.smithi099.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-02-19T21:45:13.654 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2024-02-19T21:45:17.462 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 350 kB/s | 24 kB 00:00 2024-02-19T21:45:21.017 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:45:21.020 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:45:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-02-19T21:45:21.020 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:45:21.020 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:45:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 12 M 2024-02-19T21:45:21.020 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2024-02-19T21:45:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 3.7 M 2024-02-19T21:45:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 4.2 M 2024-02-19T21:45:21.021 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-02-19T21:45:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 6.1 M 2024-02-19T21:45:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 24 M 2024-02-19T21:45:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 26 k 2024-02-19T21:45:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-19T21:45:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-19T21:45:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 825 k 2024-02-19T21:45:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-19T21:45:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-19T21:45:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 494 k 2024-02-19T21:45:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-19T21:45:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 3.8 M 2024-02-19T21:45:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-19T21:45:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-19T21:45:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 45 k 2024-02-19T21:45:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 99 k 2024-02-19T21:45:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 215 k 2024-02-19T21:45:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-19T21:45:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 389 k 2024-02-19T21:45:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 369 k 2024-02-19T21:45:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 114 k 2024-02-19T21:45:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:45:21.022 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:45:21.022 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:45:21.022 INFO:teuthology.orchestra.run.smithi099.stdout:Install 21 Packages 2024-02-19T21:45:21.022 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 2 Packages 2024-02-19T21:45:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:45:21.023 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 58 M 2024-02-19T21:45:21.023 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:45:22.438 INFO:teuthology.orchestra.run.smithi099.stdout:(1/23): ceph-base-16.2.14-548.g81bd20d6.el8.x86 5.4 MB/s | 6.1 MB 00:01 2024-02-19T21:45:22.497 INFO:teuthology.orchestra.run.smithi099.stdout:(2/23): ceph-selinux-16.2.14-548.g81bd20d6.el8. 441 kB/s | 26 kB 00:00 2024-02-19T21:45:22.989 INFO:teuthology.orchestra.run.smithi099.stdout:(3/23): ceph-radosgw-16.2.14-548.g81bd20d6.el8. 6.9 MB/s | 12 MB 00:01 2024-02-19T21:45:23.114 INFO:teuthology.orchestra.run.smithi099.stdout:(4/23): libradosstriper1-16.2.14-548.g81bd20d6. 3.9 MB/s | 494 kB 00:00 2024-02-19T21:45:23.289 INFO:teuthology.orchestra.run.smithi099.stdout:(5/23): libcephfs2-16.2.14-548.g81bd20d6.el8.x8 1.0 MB/s | 825 kB 00:00 2024-02-19T21:45:23.523 INFO:teuthology.orchestra.run.smithi099.stdout:(6/23): ceph-common-16.2.14-548.g81bd20d6.el8.x 11 MB/s | 24 MB 00:02 2024-02-19T21:45:23.548 INFO:teuthology.orchestra.run.smithi099.stdout:(7/23): python3-ceph-argparse-16.2.14-548.g81bd 174 kB/s | 45 kB 00:00 2024-02-19T21:45:23.616 INFO:teuthology.orchestra.run.smithi099.stdout:(8/23): librgw2-16.2.14-548.g81bd20d6.el8.x86_6 7.6 MB/s | 3.8 MB 00:00 2024-02-19T21:45:23.640 INFO:teuthology.orchestra.run.smithi099.stdout:(9/23): python3-ceph-common-16.2.14-548.g81bd20 845 kB/s | 99 kB 00:00 2024-02-19T21:45:23.699 INFO:teuthology.orchestra.run.smithi099.stdout:(10/23): python3-rados-16.2.14-548.g81bd20d6.el 4.6 MB/s | 389 kB 00:00 2024-02-19T21:45:23.724 INFO:teuthology.orchestra.run.smithi099.stdout:(11/23): python3-rbd-16.2.14-548.g81bd20d6.el8. 4.3 MB/s | 369 kB 00:00 2024-02-19T21:45:23.766 INFO:teuthology.orchestra.run.smithi099.stdout:(12/23): python3-rgw-16.2.14-548.g81bd20d6.el8. 1.7 MB/s | 114 kB 00:00 2024-02-19T21:45:23.792 INFO:teuthology.orchestra.run.smithi099.stdout:(13/23): python3-cephfs-16.2.14-548.g81bd20d6.e 885 kB/s | 215 kB 00:00 2024-02-19T21:45:23.883 INFO:teuthology.orchestra.run.smithi099.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 479 kB/s | 44 kB 00:00 2024-02-19T21:45:23.934 INFO:teuthology.orchestra.run.smithi099.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.5 MB/s | 259 kB 00:00 2024-02-19T21:45:23.959 INFO:teuthology.orchestra.run.smithi099.stdout:(16/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 624 kB/s | 47 kB 00:00 2024-02-19T21:45:24.109 INFO:teuthology.orchestra.run.smithi099.stdout:(17/23): librdkafka-1.6.1-1.el8.x86_64.rpm 1.7 MB/s | 677 kB 00:00 2024-02-19T21:45:24.168 INFO:teuthology.orchestra.run.smithi099.stdout:(18/23): leveldb-1.22-1.el8.x86_64.rpm 867 kB/s | 181 kB 00:00 2024-02-19T21:45:24.193 INFO:teuthology.orchestra.run.smithi099.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2024-02-19T21:45:24.227 INFO:teuthology.orchestra.run.smithi099.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 MB/s | 75 kB 00:00 2024-02-19T21:45:24.260 INFO:teuthology.orchestra.run.smithi099.stdout:(21/23): liboath-2.6.2-3.el8.x86_64.rpm 390 kB/s | 59 kB 00:00 2024-02-19T21:45:24.519 INFO:teuthology.orchestra.run.smithi099.stdout:(22/23): librbd1-16.2.14-548.g81bd20d6.el8.x86_ 14 MB/s | 4.2 MB 00:00 2024-02-19T21:45:25.702 INFO:teuthology.orchestra.run.smithi099.stdout:(23/23): librados2-16.2.14-548.g81bd20d6.el8.x8 2.5 MB/s | 3.7 MB 00:01 2024-02-19T21:45:25.704 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:45:25.704 INFO:teuthology.orchestra.run.smithi099.stdout:Total 12 MB/s | 58 MB 00:04 2024-02-19T21:45:25.749 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:45:25.796 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:45:25.796 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:45:26.140 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:45:26.143 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:45:27.183 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:45:27.375 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-02-19T21:45:27.564 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-19T21:45:27.952 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-19T21:45:28.114 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 3/25 2024-02-19T21:45:28.200 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 3/25 2024-02-19T21:45:28.454 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 4/25 2024-02-19T21:45:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 5/25 2024-02-19T21:45:29.045 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 5/25 2024-02-19T21:45:29.214 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 6/25 2024-02-19T21:45:29.282 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 6/25 2024-02-19T21:45:29.514 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/25 2024-02-19T21:45:29.979 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/25 2024-02-19T21:45:30.163 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 9/25 2024-02-19T21:45:30.238 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 9/25 2024-02-19T21:45:30.427 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2024-02-19T21:45:30.577 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:16.2.14-548.g81bd20d6.el8. 11/25 2024-02-19T21:45:30.734 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 12/25 2024-02-19T21:45:30.925 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 13/25 2024-02-19T21:45:31.112 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 14/25 2024-02-19T21:45:31.264 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_6 15/25 2024-02-19T21:45:31.334 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_6 15/25 2024-02-19T21:45:31.572 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-02-19T21:45:31.771 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-02-19T21:45:31.959 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-02-19T21:45:32.130 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:16.2.14-548.g81bd20d6.el8.x8 19/25 2024-02-19T21:45:34.691 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 20/25 2024-02-19T21:45:34.905 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 20/25 2024-02-19T21:45:35.599 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 20/25 2024-02-19T21:45:35.866 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 21/25 2024-02-19T21:45:35.969 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 21/25 2024-02-19T21:45:36.129 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 22/25 2024-02-19T21:45:55.173 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 22/25 2024-02-19T21:45:55.173 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2024-02-19T21:45:55.174 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2024-02-19T21:45:55.174 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /dev 2024-02-19T21:45:55.174 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /run 2024-02-19T21:45:55.174 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2024-02-19T21:45:55.174 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2024-02-19T21:45:55.174 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2024-02-19T21:45:55.174 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2024-02-19T21:45:55.174 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /dev 2024-02-19T21:45:55.174 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:45:56.311 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 23/25 2024-02-19T21:45:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 23/25 2024-02-19T21:45:56.388 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-19T21:45:56.584 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-19T21:45:56.585 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-19T21:45:57.261 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-19T21:45:57.261 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 1/25 2024-02-19T21:45:57.261 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 2/25 2024-02-19T21:45:57.261 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 3/25 2024-02-19T21:45:57.261 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 4/25 2024-02-19T21:45:57.261 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 5/25 2024-02-19T21:45:57.261 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_6 6/25 2024-02-19T21:45:57.261 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 7/25 2024-02-19T21:45:57.261 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:16.2.14-548.g81bd20d6.el8. 8/25 2024-02-19T21:45:57.262 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:16.2.14-548.g81bd20d6.el8.x8 9/25 2024-02-19T21:45:57.262 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 10/25 2024-02-19T21:45:57.262 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 11/25 2024-02-19T21:45:57.262 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 12/25 2024-02-19T21:45:57.262 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 13/25 2024-02-19T21:45:57.262 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-02-19T21:45:57.262 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-02-19T21:45:57.262 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-02-19T21:45:57.262 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-02-19T21:45:57.262 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-02-19T21:45:57.262 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2024-02-19T21:45:57.262 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2024-02-19T21:45:57.262 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2024-02-19T21:45:57.262 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 22/25 2024-02-19T21:45:57.263 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-02-19T21:45:57.263 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 24/25 2024-02-19T21:45:58.063 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-02-19T21:45:58.063 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:45:58.063 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2024-02-19T21:45:58.063 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.063 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.063 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:45:58.063 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.063 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.063 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.063 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.063 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-19T21:45:58.063 INFO:teuthology.orchestra.run.smithi099.stdout: leveldb-1.22-1.el8.x86_64 2024-02-19T21:45:58.064 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.064 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-19T21:45:58.064 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-19T21:45:58.064 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.064 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-19T21:45:58.064 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.064 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-19T21:45:58.064 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-19T21:45:58.064 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.064 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.064 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.064 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-19T21:45:58.064 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.065 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.065 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:45:58.065 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:45:58.065 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:45:58.370 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-test 2024-02-19T21:45:59.129 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:42 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:46:00.696 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:46:00.697 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:00.697 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-02-19T21:46:00.697 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:00.697 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:46:00.697 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 52 M 2024-02-19T21:46:00.697 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-02-19T21:46:00.697 INFO:teuthology.orchestra.run.smithi099.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-19T21:46:00.697 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 174 k 2024-02-19T21:46:00.698 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-19T21:46:00.698 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-19T21:46:00.698 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-19T21:46:00.698 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:00.698 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:46:00.698 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:00.698 INFO:teuthology.orchestra.run.smithi099.stdout:Install 6 Packages 2024-02-19T21:46:00.698 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:00.699 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 53 M 2024-02-19T21:46:00.699 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 197 M 2024-02-19T21:46:00.699 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:46:00.895 INFO:teuthology.orchestra.run.smithi099.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.3 MB/s | 203 kB 00:00 2024-02-19T21:46:00.936 INFO:teuthology.orchestra.run.smithi099.stdout:(2/6): libcephsqlite-16.2.14-548.g81bd20d6.el8. 884 kB/s | 174 kB 00:00 2024-02-19T21:46:00.970 INFO:teuthology.orchestra.run.smithi099.stdout:(3/6): oniguruma-6.8.2-3.el8.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-02-19T21:46:01.012 INFO:teuthology.orchestra.run.smithi099.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2024-02-19T21:46:01.062 INFO:teuthology.orchestra.run.smithi099.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2024-02-19T21:46:03.404 INFO:teuthology.orchestra.run.smithi099.stdout:(6/6): ceph-test-16.2.14-548.g81bd20d6.el8.x86_ 20 MB/s | 52 MB 00:02 2024-02-19T21:46:03.406 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:46:03.406 INFO:teuthology.orchestra.run.smithi099.stdout:Total 20 MB/s | 53 MB 00:02 2024-02-19T21:46:03.448 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:46:03.468 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:46:03.468 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:46:03.776 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:46:03.779 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:46:04.255 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:46:04.472 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-02-19T21:46:04.658 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-02-19T21:46:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-19T21:46:04.867 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-19T21:46:05.020 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-02-19T21:46:05.189 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 5/6 2024-02-19T21:46:09.900 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 5/6 2024-02-19T21:46:10.119 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 6/6 2024-02-19T21:46:10.403 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 6/6 2024-02-19T21:46:10.404 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 1/6 2024-02-19T21:46:10.404 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 2/6 2024-02-19T21:46:10.404 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-02-19T21:46:10.404 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-02-19T21:46:10.404 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-02-19T21:46:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-02-19T21:46:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:10.825 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:46:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:46:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: jq-1.6-8.el8.x86_64 2024-02-19T21:46:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:46:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-02-19T21:46:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-1.el8.x86_64 2024-02-19T21:46:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-02-19T21:46:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:10.826 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:46:11.025 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph 2024-02-19T21:46:11.781 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:54 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:46:13.411 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:46:13.414 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-02-19T21:46:13.415 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:13.415 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:46:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 6.4 k 2024-02-19T21:46:13.415 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-02-19T21:46:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 2.4 M 2024-02-19T21:46:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 1.6 M 2024-02-19T21:46:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 245 k 2024-02-19T21:46:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 5.2 M 2024-02-19T21:46:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 19 M 2024-02-19T21:46:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-19T21:46:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-19T21:46:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-19T21:46:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-19T21:46:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-19T21:46:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-19T21:46:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-19T21:46:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-19T21:46:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-19T21:46:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-19T21:46:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-19T21:46:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-19T21:46:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-19T21:46:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-19T21:46:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:13.417 INFO:teuthology.orchestra.run.smithi099.stdout:Install 32 Packages 2024-02-19T21:46:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:13.418 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 32 M 2024-02-19T21:46:13.418 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 104 M 2024-02-19T21:46:13.418 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:46:13.696 INFO:teuthology.orchestra.run.smithi099.stdout:(1/32): ceph-16.2.14-548.g81bd20d6.el8.x86_64.r 48 kB/s | 6.4 kB 00:00 2024-02-19T21:46:13.837 INFO:teuthology.orchestra.run.smithi099.stdout:(2/32): ceph-mgr-16.2.14-548.g81bd20d6.el8.x86_ 5.9 MB/s | 1.6 MB 00:00 2024-02-19T21:46:14.455 INFO:teuthology.orchestra.run.smithi099.stdout:(3/32): ceph-mon-16.2.14-548.g81bd20d6.el8.x86_ 6.8 MB/s | 5.2 MB 00:00 2024-02-19T21:46:14.538 INFO:teuthology.orchestra.run.smithi099.stdout:(4/32): ceph-mgr-modules-core-16.2.14-548.g81bd 2.9 MB/s | 245 kB 00:00 2024-02-19T21:46:14.747 INFO:teuthology.orchestra.run.smithi099.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 753 kB/s | 157 kB 00:00 2024-02-19T21:46:14.789 INFO:teuthology.orchestra.run.smithi099.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 929 kB/s | 39 kB 00:00 2024-02-19T21:46:14.839 INFO:teuthology.orchestra.run.smithi099.stdout:(7/32): ceph-mds-16.2.14-548.g81bd20d6.el8.x86_ 1.9 MB/s | 2.4 MB 00:01 2024-02-19T21:46:15.023 INFO:teuthology.orchestra.run.smithi099.stdout:(8/32): ceph-osd-16.2.14-548.g81bd20d6.el8.x86_ 16 MB/s | 19 MB 00:01 2024-02-19T21:46:15.048 INFO:teuthology.orchestra.run.smithi099.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 399 kB/s | 103 kB 00:00 2024-02-19T21:46:15.123 INFO:teuthology.orchestra.run.smithi099.stdout:(10/32): python3-pytz-2017.2-11.el8.noarch.rpm 201 kB/s | 57 kB 00:00 2024-02-19T21:46:15.157 INFO:teuthology.orchestra.run.smithi099.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.2 MB/s | 249 kB 00:00 2024-02-19T21:46:15.191 INFO:teuthology.orchestra.run.smithi099.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 3.2 MB/s | 109 kB 00:00 2024-02-19T21:46:15.249 INFO:teuthology.orchestra.run.smithi099.stdout:(13/32): python3-cryptography-3.2.1-7.el8.x86_6 5.0 MB/s | 641 kB 00:00 2024-02-19T21:46:15.383 INFO:teuthology.orchestra.run.smithi099.stdout:(14/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.2 MB/s | 457 kB 00:00 2024-02-19T21:46:15.566 INFO:teuthology.orchestra.run.smithi099.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 116 kB/s | 44 kB 00:00 2024-02-19T21:46:15.758 INFO:teuthology.orchestra.run.smithi099.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 364 kB/s | 185 kB 00:00 2024-02-19T21:46:15.875 INFO:teuthology.orchestra.run.smithi099.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 351 kB/s | 173 kB 00:00 2024-02-19T21:46:15.950 INFO:teuthology.orchestra.run.smithi099.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 58 kB/s | 11 kB 00:00 2024-02-19T21:46:16.001 INFO:teuthology.orchestra.run.smithi099.stdout:(19/32): python3-cherrypy-18.4.0-1.el8.noarch.r 886 kB/s | 384 kB 00:00 2024-02-19T21:46:16.042 INFO:teuthology.orchestra.run.smithi099.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 105 kB/s | 18 kB 00:00 2024-02-19T21:46:16.101 INFO:teuthology.orchestra.run.smithi099.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 324 kB/s | 49 kB 00:00 2024-02-19T21:46:16.135 INFO:teuthology.orchestra.run.smithi099.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 439 kB/s | 59 kB 00:00 2024-02-19T21:46:16.293 INFO:teuthology.orchestra.run.smithi099.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 81 kB/s | 16 kB 00:00 2024-02-19T21:46:16.319 INFO:teuthology.orchestra.run.smithi099.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 102 kB/s | 19 kB 00:00 2024-02-19T21:46:16.344 INFO:teuthology.orchestra.run.smithi099.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 940 kB/s | 283 kB 00:00 2024-02-19T21:46:16.452 INFO:teuthology.orchestra.run.smithi099.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 151 kB/s | 24 kB 00:00 2024-02-19T21:46:16.477 INFO:teuthology.orchestra.run.smithi099.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 184 kB/s | 29 kB 00:00 2024-02-19T21:46:16.503 INFO:teuthology.orchestra.run.smithi099.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 173 kB/s | 27 kB 00:00 2024-02-19T21:46:16.662 INFO:teuthology.orchestra.run.smithi099.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 539 kB/s | 85 kB 00:00 2024-02-19T21:46:16.703 INFO:teuthology.orchestra.run.smithi099.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.1 MB/s | 251 kB 00:00 2024-02-19T21:46:16.795 INFO:teuthology.orchestra.run.smithi099.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 172 kB/s | 23 kB 00:00 2024-02-19T21:46:16.820 INFO:teuthology.orchestra.run.smithi099.stdout:(32/32): python3-waitress-1.4.3-1.el8.noarch.rp 695 kB/s | 255 kB 00:00 2024-02-19T21:46:16.822 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:46:16.822 INFO:teuthology.orchestra.run.smithi099.stdout:Total 9.3 MB/s | 32 MB 00:03 2024-02-19T21:46:16.903 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:46:16.942 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:46:16.942 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:46:17.228 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:46:17.231 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:46:18.304 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:46:18.509 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-19T21:46:18.718 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-19T21:46:18.935 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-19T21:46:19.209 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-19T21:46:19.415 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-19T21:46:19.595 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-19T21:46:19.764 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-19T21:46:19.958 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-19T21:46:20.185 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-19T21:46:20.411 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-19T21:46:20.651 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-19T21:46:20.875 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-19T21:46:21.254 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-19T21:46:21.546 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-19T21:46:21.756 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-19T21:46:22.016 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-19T21:46:22.236 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-19T21:46:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-19T21:46:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-19T21:46:22.904 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-19T21:46:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-19T21:46:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-19T21:46:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-19T21:46:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-19T21:46:24.028 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-19T21:46:24.345 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-19T21:46:24.682 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-548.g81bd20d6.el8. 27/32 2024-02-19T21:46:24.864 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 28/32 2024-02-19T21:46:26.376 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 28/32 2024-02-19T21:46:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 29/32 2024-02-19T21:46:26.961 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 29/32 2024-02-19T21:46:27.143 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 30/32 2024-02-19T21:46:27.358 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 30/32 2024-02-19T21:46:27.518 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 31/32 2024-02-19T21:46:27.535 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 31/32 2024-02-19T21:46:27.633 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 32/32 2024-02-19T21:46:28.040 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 32/32 2024-02-19T21:46:28.040 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 1/32 2024-02-19T21:46:28.040 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 2/32 2024-02-19T21:46:28.040 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 3/32 2024-02-19T21:46:28.040 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 4/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 5/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-548.g81bd20d6.el8. 6/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-19T21:46:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-19T21:46:28.042 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-19T21:46:28.042 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-19T21:46:28.042 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-19T21:46:28.042 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-19T21:46:28.042 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-19T21:46:28.042 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-19T21:46:28.042 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-19T21:46:28.042 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-19T21:46:28.042 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-19T21:46:28.042 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-19T21:46:28.042 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-19T21:46:28.043 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-19T21:46:28.938 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-19T21:46:28.939 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:28.939 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:46:28.939 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:46:28.939 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:46:28.939 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:46:28.939 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:46:28.939 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:46:28.939 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:46:28.939 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-19T21:46:28.939 INFO:teuthology.orchestra.run.smithi099.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-19T21:46:28.939 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-19T21:46:28.939 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-19T21:46:28.940 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-19T21:46:28.940 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-19T21:46:28.940 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-19T21:46:28.940 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-19T21:46:28.940 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-19T21:46:28.940 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-19T21:46:28.940 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-19T21:46:28.940 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-19T21:46:28.940 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-19T21:46:28.940 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-2.6-1.el8.noarch 2024-02-19T21:46:28.940 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-19T21:46:28.940 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-19T21:46:28.940 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-19T21:46:28.941 INFO:teuthology.orchestra.run.smithi099.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-19T21:46:28.941 INFO:teuthology.orchestra.run.smithi099.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-19T21:46:28.941 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-19T21:46:28.941 INFO:teuthology.orchestra.run.smithi099.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-19T21:46:28.941 INFO:teuthology.orchestra.run.smithi099.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-19T21:46:28.941 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-19T21:46:28.941 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-19T21:46:28.941 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-19T21:46:28.941 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-19T21:46:28.941 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:28.941 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:46:29.199 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-base 2024-02-19T21:46:29.954 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:12 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:46:31.462 INFO:teuthology.orchestra.run.smithi099.stdout:Package ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:46:31.508 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:46:31.509 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-02-19T21:46:31.509 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:46:31.611 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install cephadm 2024-02-19T21:46:32.366 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:15 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:46:33.928 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:46:33.929 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-02-19T21:46:33.929 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:33.929 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:46:33.929 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 85 k 2024-02-19T21:46:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:33.930 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:46:33.930 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:33.930 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-02-19T21:46:33.930 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:33.930 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 85 k 2024-02-19T21:46:33.930 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 352 k 2024-02-19T21:46:33.930 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:46:34.308 INFO:teuthology.orchestra.run.smithi099.stdout:cephadm-16.2.14-548.g81bd20d6.el8.noarch.rpm 226 kB/s | 85 kB 00:00 2024-02-19T21:46:34.309 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:46:34.309 INFO:teuthology.orchestra.run.smithi099.stdout:Total 225 kB/s | 85 kB 00:00 2024-02-19T21:46:34.309 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:46:34.316 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:46:34.316 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:46:34.319 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:46:34.322 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:46:34.367 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:46:34.876 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:46:35.041 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:46:35.276 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:46:35.638 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:46:35.638 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:35.638 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:46:35.638 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:46:35.638 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:35.638 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:46:35.842 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-immutable-object-cache 2024-02-19T21:46:36.600 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:19 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:46:36.908 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 193 kB/s | 16 MB 01:25 2024-02-19T21:46:38.158 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:46:38.158 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-02-19T21:46:38.159 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:38.159 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:46:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 161 k 2024-02-19T21:46:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:38.159 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:46:38.159 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:38.159 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-02-19T21:46:38.159 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:38.159 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 161 k 2024-02-19T21:46:38.159 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 470 k 2024-02-19T21:46:38.159 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:46:38.355 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-immutable-object-cache-16.2.14-548.g81bd20 827 kB/s | 161 kB 00:00 2024-02-19T21:46:38.355 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:46:38.355 INFO:teuthology.orchestra.run.smithi099.stdout:Total 821 kB/s | 161 kB 00:00 2024-02-19T21:46:38.356 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:46:38.366 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:46:38.366 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:46:38.413 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:46:38.416 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:46:38.529 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:46:38.690 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6. 1/1 2024-02-19T21:46:39.103 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6. 1/1 2024-02-19T21:46:39.486 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6. 1/1 2024-02-19T21:46:39.487 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:39.487 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:46:39.487 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:46:39.487 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:39.487 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:46:39.693 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr 2024-02-19T21:46:40.446 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:23 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:46:40.742 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 458 kB/s | 24 kB 00:00 2024-02-19T21:46:41.961 INFO:teuthology.orchestra.run.smithi099.stdout:Package ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:46:42.007 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:46:42.008 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-02-19T21:46:42.008 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:46:42.573 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-dashboard 2024-02-19T21:46:43.325 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:26 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:46:44.413 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:46:44.415 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:46:44.415 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-19T21:46:44.415 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:46:44.416 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:46:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 12 M 2024-02-19T21:46:44.416 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrading: 2024-02-19T21:46:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: librados2 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 3.7 M 2024-02-19T21:46:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 4.2 M 2024-02-19T21:46:44.416 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-19T21:46:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 6.1 M 2024-02-19T21:46:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 24 M 2024-02-19T21:46:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 26 k 2024-02-19T21:46:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-19T21:46:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-19T21:46:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 825 k 2024-02-19T21:46:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-19T21:46:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-19T21:46:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 494 k 2024-02-19T21:46:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-19T21:46:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2 x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 3.8 M 2024-02-19T21:46:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-19T21:46:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-19T21:46:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 45 k 2024-02-19T21:46:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 99 k 2024-02-19T21:46:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 215 k 2024-02-19T21:46:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-19T21:46:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 389 k 2024-02-19T21:46:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 369 k 2024-02-19T21:46:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 114 k 2024-02-19T21:46:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:46:44.418 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:46:44.418 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:46:44.418 INFO:teuthology.orchestra.run.smithi138.stdout:Install 21 Packages 2024-02-19T21:46:44.418 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrade 2 Packages 2024-02-19T21:46:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:46:44.419 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 58 M 2024-02-19T21:46:44.419 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:46:44.878 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:46:44.879 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:44.879 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-02-19T21:46:44.879 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:44.880 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:46:44.880 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 3.1 M 2024-02-19T21:46:44.880 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-02-19T21:46:44.880 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 24 k 2024-02-19T21:46:44.880 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 15 k 2024-02-19T21:46:44.880 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-02-19T21:46:44.880 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-02-19T21:46:44.880 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-02-19T21:46:44.880 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:44.880 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:46:44.880 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:46:44.880 INFO:teuthology.orchestra.run.smithi099.stdout:Install 6 Packages 2024-02-19T21:46:44.880 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:44.881 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 3.4 M 2024-02-19T21:46:44.881 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 22 M 2024-02-19T21:46:44.881 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:46:45.223 INFO:teuthology.orchestra.run.smithi099.stdout:(1/6): ceph-grafana-dashboards-16.2.14-548.g81b 90 kB/s | 24 kB 00:00 2024-02-19T21:46:45.248 INFO:teuthology.orchestra.run.smithi099.stdout:(2/6): ceph-prometheus-alerts-16.2.14-548.g81bd 50 kB/s | 15 kB 00:00 2024-02-19T21:46:45.307 INFO:teuthology.orchestra.run.smithi099.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 509 kB/s | 43 kB 00:00 2024-02-19T21:46:45.374 INFO:teuthology.orchestra.run.smithi099.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 268 kB/s | 34 kB 00:00 2024-02-19T21:46:45.926 INFO:teuthology.orchestra.run.smithi138.stdout:(1/23): ceph-base-16.2.14-548.g81bd20d6.el8.x86 5.0 MB/s | 6.1 MB 00:01 2024-02-19T21:46:45.977 INFO:teuthology.orchestra.run.smithi138.stdout:(2/23): ceph-selinux-16.2.14-548.g81bd20d6.el8. 508 kB/s | 26 kB 00:00 2024-02-19T21:46:46.127 INFO:teuthology.orchestra.run.smithi138.stdout:(3/23): libcephfs2-16.2.14-548.g81bd20d6.el8.x8 5.4 MB/s | 825 kB 00:00 2024-02-19T21:46:46.219 INFO:teuthology.orchestra.run.smithi138.stdout:(4/23): libradosstriper1-16.2.14-548.g81bd20d6. 5.3 MB/s | 494 kB 00:00 2024-02-19T21:46:46.649 INFO:teuthology.orchestra.run.smithi099.stdout:(5/6): ceph-mgr-dashboard-16.2.14-548.g81bd20d6 1.8 MB/s | 3.1 MB 00:01 2024-02-19T21:46:46.703 INFO:teuthology.orchestra.run.smithi138.stdout:(5/23): librgw2-16.2.14-548.g81bd20d6.el8.x86_6 7.9 MB/s | 3.8 MB 00:00 2024-02-19T21:46:46.787 INFO:teuthology.orchestra.run.smithi138.stdout:(6/23): python3-ceph-argparse-16.2.14-548.g81bd 540 kB/s | 45 kB 00:00 2024-02-19T21:46:47.321 INFO:teuthology.orchestra.run.smithi138.stdout:(7/23): python3-ceph-common-16.2.14-548.g81bd20 185 kB/s | 99 kB 00:00 2024-02-19T21:46:47.395 INFO:teuthology.orchestra.run.smithi138.stdout:(8/23): python3-cephfs-16.2.14-548.g81bd20d6.el 2.8 MB/s | 215 kB 00:00 2024-02-19T21:46:47.479 INFO:teuthology.orchestra.run.smithi138.stdout:(9/23): python3-rados-16.2.14-548.g81bd20d6.el8 4.6 MB/s | 389 kB 00:00 2024-02-19T21:46:47.571 INFO:teuthology.orchestra.run.smithi138.stdout:(10/23): python3-rbd-16.2.14-548.g81bd20d6.el8. 3.9 MB/s | 369 kB 00:00 2024-02-19T21:46:47.655 INFO:teuthology.orchestra.run.smithi138.stdout:(11/23): python3-rgw-16.2.14-548.g81bd20d6.el8. 1.3 MB/s | 114 kB 00:00 2024-02-19T21:46:47.888 INFO:teuthology.orchestra.run.smithi138.stdout:(12/23): librdkafka-1.6.1-1.el8.x86_64.rpm 2.8 MB/s | 677 kB 00:00 2024-02-19T21:46:48.189 INFO:teuthology.orchestra.run.smithi138.stdout:(13/23): ceph-common-16.2.14-548.g81bd20d6.el8. 7.0 MB/s | 24 MB 00:03 2024-02-19T21:46:48.214 INFO:teuthology.orchestra.run.smithi138.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 797 kB/s | 259 kB 00:00 2024-02-19T21:46:48.281 INFO:teuthology.orchestra.run.smithi138.stdout:(15/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-02-19T21:46:48.298 INFO:teuthology.orchestra.run.smithi138.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 404 kB/s | 44 kB 00:00 2024-02-19T21:46:48.582 INFO:teuthology.orchestra.run.smithi099.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 60 kB/s | 196 kB 00:03 2024-02-19T21:46:48.584 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:46:48.584 INFO:teuthology.orchestra.run.smithi099.stdout:Total 949 kB/s | 3.4 MB 00:03 2024-02-19T21:46:48.595 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:46:48.606 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:46:48.606 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:46:48.690 INFO:teuthology.orchestra.run.smithi138.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 462 kB/s | 181 kB 00:00 2024-02-19T21:46:48.786 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:46:48.789 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:46:48.799 INFO:teuthology.orchestra.run.smithi138.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 592 kB/s | 306 kB 00:00 2024-02-19T21:46:48.816 INFO:teuthology.orchestra.run.smithi138.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 469 kB/s | 59 kB 00:00 2024-02-19T21:46:48.925 INFO:teuthology.orchestra.run.smithi138.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 598 kB/s | 75 kB 00:00 2024-02-19T21:46:49.057 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:46:49.234 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-02-19T21:46:49.430 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-02-19T21:46:49.509 INFO:teuthology.orchestra.run.smithi138.stdout:(21/23): ceph-radosgw-16.2.14-548.g81bd20d6.el8 2.4 MB/s | 12 MB 00:04 2024-02-19T21:46:49.592 INFO:teuthology.orchestra.run.smithi138.stdout:(22/23): librados2-16.2.14-548.g81bd20d6.el8.x8 4.8 MB/s | 3.7 MB 00:00 2024-02-19T21:46:49.598 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-02-19T21:46:49.694 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-548.g81bd20d6.el8.n 4/6 2024-02-19T21:46:49.901 INFO:teuthology.orchestra.run.smithi138.stdout:(23/23): librbd1-16.2.14-548.g81bd20d6.el8.x86_ 4.3 MB/s | 4.2 MB 00:00 2024-02-19T21:46:49.903 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:46:49.903 INFO:teuthology.orchestra.run.smithi138.stdout:Total 11 MB/s | 58 MB 00:05 2024-02-19T21:46:49.946 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:46:49.993 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:46:49.993 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:46:50.359 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:46:50.362 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:46:50.679 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-548.g81bd20d6.el8. 5/6 2024-02-19T21:46:50.957 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarc 6/6 2024-02-19T21:46:51.230 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarc 6/6 2024-02-19T21:46:51.230 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-548.g81bd20d6.el8. 1/6 2024-02-19T21:46:51.231 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarc 2/6 2024-02-19T21:46:51.231 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-548.g81bd20d6.el8.n 3/6 2024-02-19T21:46:51.231 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-02-19T21:46:51.231 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-02-19T21:46:51.477 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:46:51.609 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-02-19T21:46:51.609 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:51.609 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:46:51.609 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:46:51.609 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:46:51.609 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:46:51.609 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-02-19T21:46:51.610 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-02-19T21:46:51.610 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.4.1-12.el8.noarch 2024-02-19T21:46:51.610 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:51.610 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:46:51.731 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-19T21:46:51.736 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-02-19T21:46:51.950 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-19T21:46:52.337 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-19T21:46:52.482 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:35 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:46:52.575 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 3/25 2024-02-19T21:46:52.669 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 3/25 2024-02-19T21:46:52.989 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 4/25 2024-02-19T21:46:53.208 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 5/25 2024-02-19T21:46:53.624 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 5/25 2024-02-19T21:46:53.883 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 6/25 2024-02-19T21:46:53.950 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 6/25 2024-02-19T21:46:54.051 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:46:54.052 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================================ 2024-02-19T21:46:54.052 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-02-19T21:46:54.052 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================================ 2024-02-19T21:46:54.052 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:46:54.052 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 8.6 M 2024-02-19T21:46:54.052 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-02-19T21:46:54.052 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-02-19T21:46:54.052 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-02-19T21:46:54.052 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-02-19T21:46:54.053 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-02-19T21:46:54.053 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-02-19T21:46:54.053 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-02-19T21:46:54.053 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-02-19T21:46:54.053 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:54.053 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:46:54.053 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================================ 2024-02-19T21:46:54.053 INFO:teuthology.orchestra.run.smithi099.stdout:Install 8 Packages 2024-02-19T21:46:54.053 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:46:54.054 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 37 M 2024-02-19T21:46:54.054 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 210 M 2024-02-19T21:46:54.054 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:46:54.193 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/25 2024-02-19T21:46:54.688 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/25 2024-02-19T21:46:54.883 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 9/25 2024-02-19T21:46:54.958 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 9/25 2024-02-19T21:46:55.189 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2024-02-19T21:46:55.375 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-argparse-2:16.2.14-548.g81bd20d6.el8. 11/25 2024-02-19T21:46:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 12/25 2024-02-19T21:46:55.817 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 13/25 2024-02-19T21:46:56.066 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 14/25 2024-02-19T21:46:56.144 INFO:teuthology.orchestra.run.smithi099.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.14-54 4.6 MB/s | 8.6 MB 00:01 2024-02-19T21:46:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_6 15/25 2024-02-19T21:46:56.295 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_6 15/25 2024-02-19T21:46:56.567 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-02-19T21:46:56.595 INFO:teuthology.orchestra.run.smithi099.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 8.3 MB/s | 3.7 MB 00:00 2024-02-19T21:46:56.637 INFO:teuthology.orchestra.run.smithi099.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 5.3 MB/s | 225 kB 00:00 2024-02-19T21:46:56.791 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-02-19T21:46:56.803 INFO:teuthology.orchestra.run.smithi099.stdout:(4/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 1.9 MB/s | 4.9 MB 00:02 2024-02-19T21:46:56.912 INFO:teuthology.orchestra.run.smithi099.stdout:(5/8): openblas-0.3.15-4.el8.x86_64.rpm 1.8 MB/s | 4.7 MB 00:02 2024-02-19T21:46:56.963 INFO:teuthology.orchestra.run.smithi099.stdout:(6/8): libgfortran-8.5.0-21.el8.x86_64.rpm 4.0 MB/s | 645 kB 00:00 2024-02-19T21:46:56.988 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-02-19T21:46:56.996 INFO:teuthology.orchestra.run.smithi099.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 2.0 MB/s | 172 kB 00:00 2024-02-19T21:46:57.166 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-common-2:16.2.14-548.g81bd20d6.el8.x8 19/25 2024-02-19T21:46:57.871 INFO:teuthology.orchestra.run.smithi099.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 11 MB/s | 14 MB 00:01 2024-02-19T21:46:57.871 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:46:57.872 INFO:teuthology.orchestra.run.smithi099.stdout:Total 9.7 MB/s | 37 MB 00:03 2024-02-19T21:46:58.103 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:46:58.121 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:46:58.121 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:46:58.514 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:46:58.517 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:46:59.743 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 20/25 2024-02-19T21:46:59.788 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:46:59.943 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-19T21:46:59.958 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 20/25 2024-02-19T21:47:00.082 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-19T21:47:00.214 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-19T21:47:00.656 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 20/25 2024-02-19T21:47:00.814 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-19T21:47:00.957 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 21/25 2024-02-19T21:47:00.976 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-02-19T21:47:01.059 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 21/25 2024-02-19T21:47:01.240 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 22/25 2024-02-19T21:47:01.588 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-02-19T21:47:01.722 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-19T21:47:02.441 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-19T21:47:02.770 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-02-19T21:47:03.013 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-19T21:47:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-19T21:47:06.089 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-02-19T21:47:06.279 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d 8/8 2024-02-19T21:47:06.594 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d 8/8 2024-02-19T21:47:06.594 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d 1/8 2024-02-19T21:47:06.594 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-02-19T21:47:06.594 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-02-19T21:47:06.594 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-02-19T21:47:06.594 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-02-19T21:47:06.594 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-02-19T21:47:06.595 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-02-19T21:47:07.004 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-02-19T21:47:07.004 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:07.004 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:47:07.004 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:47:07.004 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-02-19T21:47:07.004 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-02-19T21:47:07.004 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.15-4.el8.x86_64 2024-02-19T21:47:07.004 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-02-19T21:47:07.004 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-02-19T21:47:07.005 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-02-19T21:47:07.005 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-02-19T21:47:07.005 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:07.005 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:47:07.115 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-rook 2024-02-19T21:47:07.866 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:50 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:47:09.436 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:47:09.438 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:09.438 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-02-19T21:47:09.438 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:09.438 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:47:09.438 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 27 k 2024-02-19T21:47:09.438 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-02-19T21:47:09.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-02-19T21:47:09.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout:Install 13 Packages 2024-02-19T21:47:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:09.440 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 1.9 M 2024-02-19T21:47:09.440 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 24 M 2024-02-19T21:47:09.440 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:47:09.893 INFO:teuthology.orchestra.run.smithi099.stdout:(1/13): python3-jsonpointer-1.10-11.el8.noarch. 167 kB/s | 20 kB 00:00 2024-02-19T21:47:09.918 INFO:teuthology.orchestra.run.smithi099.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 183 kB/s | 27 kB 00:00 2024-02-19T21:47:10.027 INFO:teuthology.orchestra.run.smithi099.stdout:(3/13): ceph-mgr-rook-16.2.14-548.g81bd20d6.el8 108 kB/s | 27 kB 00:00 2024-02-19T21:47:10.052 INFO:teuthology.orchestra.run.smithi099.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 797 kB/s | 126 kB 00:00 2024-02-19T21:47:10.078 INFO:teuthology.orchestra.run.smithi099.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 692 kB/s | 110 kB 00:00 2024-02-19T21:47:10.136 INFO:teuthology.orchestra.run.smithi099.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 509 kB/s | 43 kB 00:00 2024-02-19T21:47:10.178 INFO:teuthology.orchestra.run.smithi099.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.0 MB/s | 155 kB 00:00 2024-02-19T21:47:10.553 INFO:teuthology.orchestra.run.smithi099.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 69 kB/s | 33 kB 00:00 2024-02-19T21:47:10.579 INFO:teuthology.orchestra.run.smithi099.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 37 kB/s | 16 kB 00:00 2024-02-19T21:47:10.721 INFO:teuthology.orchestra.run.smithi099.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 151 kB/s | 81 kB 00:00 2024-02-19T21:47:10.763 INFO:teuthology.orchestra.run.smithi099.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 349 kB/s | 64 kB 00:00 2024-02-19T21:47:10.830 INFO:teuthology.orchestra.run.smithi099.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 565 kB/s | 61 kB 00:00 2024-02-19T21:47:12.188 INFO:teuthology.orchestra.run.smithi099.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 730 kB/s | 1.2 MB 00:01 2024-02-19T21:47:12.191 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:47:12.191 INFO:teuthology.orchestra.run.smithi099.stdout:Total 711 kB/s | 1.9 MB 00:02 2024-02-19T21:47:12.246 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:47:12.261 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:47:12.261 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:47:12.349 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:47:12.353 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:47:12.858 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:47:13.093 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-02-19T21:47:13.273 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-02-19T21:47:13.483 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-02-19T21:47:13.705 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-02-19T21:47:13.929 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-02-19T21:47:14.156 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-02-19T21:47:14.436 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-02-19T21:47:14.669 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-02-19T21:47:15.713 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-02-19T21:47:15.996 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-02-19T21:47:16.201 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-02-19T21:47:16.406 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-02-19T21:47:16.564 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 13/13 2024-02-19T21:47:16.866 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 13/13 2024-02-19T21:47:16.866 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 1/13 2024-02-19T21:47:16.866 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-02-19T21:47:16.866 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-02-19T21:47:16.866 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-02-19T21:47:16.866 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-02-19T21:47:16.867 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-02-19T21:47:16.867 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-02-19T21:47:16.867 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-02-19T21:47:16.867 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-02-19T21:47:16.867 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-02-19T21:47:16.867 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-02-19T21:47:16.867 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-02-19T21:47:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-02-19T21:47:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:17.321 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el8.noarch 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:17.322 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:47:17.431 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-cephadm 2024-02-19T21:47:18.185 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:01 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:47:19.733 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:47:19.734 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:19.734 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-02-19T21:47:19.734 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:19.734 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:47:19.734 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 116 k 2024-02-19T21:47:19.734 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-02-19T21:47:19.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-02-19T21:47:19.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-02-19T21:47:19.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-02-19T21:47:19.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-02-19T21:47:19.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-02-19T21:47:19.735 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:47:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:Install 6 Packages 2024-02-19T21:47:19.735 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 5.9 M 2024-02-19T21:47:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 24 M 2024-02-19T21:47:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:47:20.303 INFO:teuthology.orchestra.run.smithi099.stdout:(1/6): ceph-mgr-cephadm-16.2.14-548.g81bd20d6.e 628 kB/s | 116 kB 00:00 2024-02-19T21:47:20.362 INFO:teuthology.orchestra.run.smithi099.stdout:(2/6): python3-apipkg-1.5-6.el8.noarch.rpm 363 kB/s | 21 kB 00:00 2024-02-19T21:47:20.374 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 22/25 2024-02-19T21:47:20.374 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /sys 2024-02-19T21:47:20.375 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /proc 2024-02-19T21:47:20.375 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /dev 2024-02-19T21:47:20.375 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /run 2024-02-19T21:47:20.375 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /mnt 2024-02-19T21:47:20.375 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /var/tmp 2024-02-19T21:47:20.375 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /home 2024-02-19T21:47:20.376 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /tmp 2024-02-19T21:47:20.376 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /dev 2024-02-19T21:47:20.376 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:47:20.437 INFO:teuthology.orchestra.run.smithi099.stdout:(3/6): python3-execnet-1.7.1-1.el8.noarch.rpm 4.6 MB/s | 355 kB 00:00 2024-02-19T21:47:20.471 INFO:teuthology.orchestra.run.smithi099.stdout:(4/6): python3-remoto-1.2.1-1.el8.noarch.rpm 1.4 MB/s | 49 kB 00:00 2024-02-19T21:47:20.571 INFO:teuthology.orchestra.run.smithi099.stdout:(5/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 1.2 MB/s | 578 kB 00:00 2024-02-19T21:47:21.528 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 23/25 2024-02-19T21:47:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 23/25 2024-02-19T21:47:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-19T21:47:21.856 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-19T21:47:21.856 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-19T21:47:22.545 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-19T21:47:22.546 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 1/25 2024-02-19T21:47:22.546 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 2/25 2024-02-19T21:47:22.546 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 3/25 2024-02-19T21:47:22.546 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 4/25 2024-02-19T21:47:22.546 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 5/25 2024-02-19T21:47:22.546 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_6 6/25 2024-02-19T21:47:22.546 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 7/25 2024-02-19T21:47:22.546 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-argparse-2:16.2.14-548.g81bd20d6.el8. 8/25 2024-02-19T21:47:22.546 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-common-2:16.2.14-548.g81bd20d6.el8.x8 9/25 2024-02-19T21:47:22.546 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 10/25 2024-02-19T21:47:22.546 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 11/25 2024-02-19T21:47:22.546 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 12/25 2024-02-19T21:47:22.546 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 13/25 2024-02-19T21:47:22.547 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-02-19T21:47:22.547 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-02-19T21:47:22.547 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-02-19T21:47:22.547 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-02-19T21:47:22.547 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-02-19T21:47:22.547 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2024-02-19T21:47:22.547 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2024-02-19T21:47:22.547 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2024-02-19T21:47:22.547 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 22/25 2024-02-19T21:47:22.547 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-02-19T21:47:22.547 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 24/25 2024-02-19T21:47:23.087 INFO:teuthology.orchestra.run.smithi099.stdout:(6/6): python3-babel-2.5.1-7.el8.noarch.rpm 1.6 MB/s | 4.8 MB 00:02 2024-02-19T21:47:23.088 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:47:23.088 INFO:teuthology.orchestra.run.smithi099.stdout:Total 1.8 MB/s | 5.9 MB 00:03 2024-02-19T21:47:23.141 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:47:23.151 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:47:23.151 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:47:23.253 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:47:23.256 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:47:23.526 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-02-19T21:47:23.526 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:47:23.526 INFO:teuthology.orchestra.run.smithi138.stdout:Upgraded: 2024-02-19T21:47:23.526 INFO:teuthology.orchestra.run.smithi138.stdout: librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.526 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.526 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:47:23.526 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.527 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.527 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.527 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.527 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-19T21:47:23.527 INFO:teuthology.orchestra.run.smithi138.stdout: leveldb-1.22-1.el8.x86_64 2024-02-19T21:47:23.527 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.527 INFO:teuthology.orchestra.run.smithi138.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-19T21:47:23.527 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-19T21:47:23.527 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.527 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-19T21:47:23.527 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.527 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-19T21:47:23.527 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-19T21:47:23.527 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.528 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.528 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.528 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-19T21:47:23.528 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.528 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.528 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:23.528 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:47:23.528 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:47:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:47:23.833 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-test 2024-02-19T21:47:23.870 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-02-19T21:47:24.148 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-02-19T21:47:24.593 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:44 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:47:25.088 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-02-19T21:47:25.514 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-02-19T21:47:25.778 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-02-19T21:47:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 6/6 2024-02-19T21:47:26.148 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:47:26.149 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:47:26.149 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-19T21:47:26.149 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:47:26.149 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:47:26.149 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 52 M 2024-02-19T21:47:26.149 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-19T21:47:26.149 INFO:teuthology.orchestra.run.smithi138.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-19T21:47:26.150 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 174 k 2024-02-19T21:47:26.150 INFO:teuthology.orchestra.run.smithi138.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-19T21:47:26.150 INFO:teuthology.orchestra.run.smithi138.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-19T21:47:26.150 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-19T21:47:26.150 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:47:26.150 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:47:26.150 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:47:26.150 INFO:teuthology.orchestra.run.smithi138.stdout:Install 6 Packages 2024-02-19T21:47:26.150 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:47:26.151 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 53 M 2024-02-19T21:47:26.151 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 197 M 2024-02-19T21:47:26.151 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:47:26.255 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 6/6 2024-02-19T21:47:26.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/6 2024-02-19T21:47:26.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-02-19T21:47:26.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-02-19T21:47:26.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-02-19T21:47:26.256 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-02-19T21:47:26.346 INFO:teuthology.orchestra.run.smithi138.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.3 MB/s | 203 kB 00:00 2024-02-19T21:47:26.467 INFO:teuthology.orchestra.run.smithi138.stdout:(2/6): oniguruma-6.8.2-3.el8.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-02-19T21:47:26.580 INFO:teuthology.orchestra.run.smithi138.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 2.8 MB/s | 323 kB 00:00 2024-02-19T21:47:26.647 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-02-19T21:47:26.647 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:26.647 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:47:26.647 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:47:26.647 INFO:teuthology.orchestra.run.smithi099.stdout: python3-apipkg-1.5-6.el8.noarch 2024-02-19T21:47:26.647 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.5.1-7.el8.noarch 2024-02-19T21:47:26.647 INFO:teuthology.orchestra.run.smithi099.stdout: python3-execnet-1.7.1-1.el8.noarch 2024-02-19T21:47:26.647 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-02-19T21:47:26.647 INFO:teuthology.orchestra.run.smithi099.stdout: python3-remoto-1.2.1-1.el8.noarch 2024-02-19T21:47:26.647 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:26.647 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:47:26.680 INFO:teuthology.orchestra.run.smithi138.stdout:(4/6): libcephsqlite-16.2.14-548.g81bd20d6.el8. 356 kB/s | 174 kB 00:00 2024-02-19T21:47:26.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-fuse 2024-02-19T21:47:26.830 INFO:teuthology.orchestra.run.smithi138.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 282 kB/s | 71 kB 00:00 2024-02-19T21:47:27.513 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:10 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:47:29.069 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:47:29.070 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:29.070 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-02-19T21:47:29.070 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:29.070 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:47:29.070 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 911 k 2024-02-19T21:47:29.070 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-02-19T21:47:29.070 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-19T21:47:29.070 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:29.071 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:47:29.071 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:29.071 INFO:teuthology.orchestra.run.smithi099.stdout:Install 2 Packages 2024-02-19T21:47:29.071 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:29.071 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 994 k 2024-02-19T21:47:29.071 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 2.8 M 2024-02-19T21:47:29.072 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:47:29.330 INFO:teuthology.orchestra.run.smithi099.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2024-02-19T21:47:29.597 INFO:teuthology.orchestra.run.smithi099.stdout:(2/2): ceph-fuse-16.2.14-548.g81bd20d6.el8.x86_ 2.6 MB/s | 911 kB 00:00 2024-02-19T21:47:29.597 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:47:29.597 INFO:teuthology.orchestra.run.smithi099.stdout:Total 1.8 MB/s | 994 kB 00:00 2024-02-19T21:47:29.609 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:47:29.631 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:47:29.631 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:47:29.722 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:47:29.725 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:47:29.890 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:47:30.135 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-19T21:47:30.324 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 2/2 2024-02-19T21:47:30.708 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 2/2 2024-02-19T21:47:30.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/2 2024-02-19T21:47:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-19T21:47:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:31.284 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:47:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-19T21:47:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:31.285 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:47:31.484 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librados-devel 2024-02-19T21:47:32.249 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:15 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:47:33.809 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:47:33.810 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:33.810 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-02-19T21:47:33.810 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:33.810 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:47:33.810 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 131 k 2024-02-19T21:47:33.810 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:33.811 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:47:33.811 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:33.811 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-02-19T21:47:33.811 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:33.811 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 131 k 2024-02-19T21:47:33.811 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 432 k 2024-02-19T21:47:33.811 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:47:34.358 INFO:teuthology.orchestra.run.smithi099.stdout:librados-devel-16.2.14-548.g81bd20d6.el8.x86_64 239 kB/s | 131 kB 00:00 2024-02-19T21:47:34.359 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:47:34.359 INFO:teuthology.orchestra.run.smithi099.stdout:Total 239 kB/s | 131 kB 00:00 2024-02-19T21:47:34.359 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:47:34.364 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:47:34.364 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:47:34.417 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:47:34.419 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:47:34.527 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:47:34.751 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:47:35.029 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:47:35.393 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:47:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:35.394 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:47:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:35.394 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:35.394 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:47:35.593 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install libcephfs2 2024-02-19T21:47:36.353 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:19 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:47:37.855 INFO:teuthology.orchestra.run.smithi099.stdout:Package libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:47:37.900 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:47:37.901 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-02-19T21:47:37.901 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:47:38.240 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install libcephfs-devel 2024-02-19T21:47:39.004 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:22 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:47:40.546 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:47:40.547 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:40.547 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-02-19T21:47:40.547 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:40.548 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:47:40.548 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 25 k 2024-02-19T21:47:40.548 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:40.548 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:47:40.548 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:40.548 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-02-19T21:47:40.548 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:40.548 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 25 k 2024-02-19T21:47:40.548 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 107 k 2024-02-19T21:47:40.548 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:47:40.949 INFO:teuthology.orchestra.run.smithi099.stdout:libcephfs-devel-16.2.14-548.g81bd20d6.el8.x86_6 64 kB/s | 25 kB 00:00 2024-02-19T21:47:40.950 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:47:40.950 INFO:teuthology.orchestra.run.smithi099.stdout:Total 63 kB/s | 25 kB 00:00 2024-02-19T21:47:40.950 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:47:40.953 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:47:40.954 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:47:40.956 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:47:40.959 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:47:41.012 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:47:41.174 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:47:41.431 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:47:41.487 INFO:teuthology.orchestra.run.smithi138.stdout:(6/6): ceph-test-16.2.14-548.g81bd20d6.el8.x86_ 3.4 MB/s | 52 MB 00:15 2024-02-19T21:47:41.489 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:47:41.489 INFO:teuthology.orchestra.run.smithi138.stdout:Total 3.5 MB/s | 53 MB 00:15 2024-02-19T21:47:41.532 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:47:41.552 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:47:41.552 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:47:41.765 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:47:41.765 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:41.765 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:47:41.765 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:41.765 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:41.765 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:47:41.871 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librados2 2024-02-19T21:47:41.873 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:47:41.876 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:47:42.383 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:47:42.598 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-02-19T21:47:42.632 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:25 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:47:42.828 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-02-19T21:47:43.009 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-19T21:47:43.092 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-19T21:47:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-02-19T21:47:43.442 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 5/6 2024-02-19T21:47:44.146 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:47:44.191 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:47:44.192 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-02-19T21:47:44.192 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:47:44.294 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librbd1 2024-02-19T21:47:45.053 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:28 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:47:46.565 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:47:46.611 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:47:46.612 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-02-19T21:47:46.612 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:47:46.721 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rados 2024-02-19T21:47:47.474 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:30 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:47:48.072 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 5/6 2024-02-19T21:47:48.339 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 6/6 2024-02-19T21:47:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 6/6 2024-02-19T21:47:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 1/6 2024-02-19T21:47:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 2/6 2024-02-19T21:47:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-02-19T21:47:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-02-19T21:47:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-02-19T21:47:48.983 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:47:49.028 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:47:49.029 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-02-19T21:47:49.029 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:47:49.063 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-02-19T21:47:49.063 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:47:49.063 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:47:49.063 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:49.063 INFO:teuthology.orchestra.run.smithi138.stdout: jq-1.6-8.el8.x86_64 2024-02-19T21:47:49.063 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:47:49.063 INFO:teuthology.orchestra.run.smithi138.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-02-19T21:47:49.063 INFO:teuthology.orchestra.run.smithi138.stdout: socat-1.7.4.1-1.el8.x86_64 2024-02-19T21:47:49.064 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-02-19T21:47:49.064 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:47:49.064 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:47:49.119 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rgw 2024-02-19T21:47:49.314 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph 2024-02-19T21:47:49.868 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:32 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:47:50.078 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:10 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:47:51.398 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:47:51.442 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:47:51.443 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-02-19T21:47:51.444 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:47:51.544 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-cephfs 2024-02-19T21:47:51.629 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:47:51.632 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:47:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-19T21:47:51.632 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:47:51.632 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: ceph x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 6.4 k 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 2.4 M 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 1.6 M 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 245 k 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 5.2 M 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 19 M 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-19T21:47:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-19T21:47:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-19T21:47:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-19T21:47:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-19T21:47:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-19T21:47:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-19T21:47:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-19T21:47:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-19T21:47:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-19T21:47:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-19T21:47:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-19T21:47:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-19T21:47:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-19T21:47:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-19T21:47:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-19T21:47:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-19T21:47:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-19T21:47:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-19T21:47:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-19T21:47:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:47:51.635 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:47:51.635 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:47:51.635 INFO:teuthology.orchestra.run.smithi138.stdout:Install 32 Packages 2024-02-19T21:47:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:47:51.636 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 32 M 2024-02-19T21:47:51.636 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 104 M 2024-02-19T21:47:51.636 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:47:52.296 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:35 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:47:52.341 INFO:teuthology.orchestra.run.smithi138.stdout:(1/32): ceph-16.2.14-548.g81bd20d6.el8.x86_64.r 43 kB/s | 6.4 kB 00:00 2024-02-19T21:47:52.777 INFO:teuthology.orchestra.run.smithi138.stdout:(2/32): ceph-mgr-16.2.14-548.g81bd20d6.el8.x86_ 2.8 MB/s | 1.6 MB 00:00 2024-02-19T21:47:52.911 INFO:teuthology.orchestra.run.smithi138.stdout:(3/32): ceph-mon-16.2.14-548.g81bd20d6.el8.x86_ 9.1 MB/s | 5.2 MB 00:00 2024-02-19T21:47:52.953 INFO:teuthology.orchestra.run.smithi138.stdout:(4/32): ceph-mds-16.2.14-548.g81bd20d6.el8.x86_ 3.2 MB/s | 2.4 MB 00:00 2024-02-19T21:47:53.020 INFO:teuthology.orchestra.run.smithi138.stdout:(5/32): ceph-mgr-modules-core-16.2.14-548.g81bd 2.2 MB/s | 245 kB 00:00 2024-02-19T21:47:53.137 INFO:teuthology.orchestra.run.smithi138.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 332 kB/s | 39 kB 00:00 2024-02-19T21:47:53.162 INFO:teuthology.orchestra.run.smithi138.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 751 kB/s | 157 kB 00:00 2024-02-19T21:47:53.221 INFO:teuthology.orchestra.run.smithi138.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 975 kB/s | 57 kB 00:00 2024-02-19T21:47:53.347 INFO:teuthology.orchestra.run.smithi138.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 495 kB/s | 103 kB 00:00 2024-02-19T21:47:53.380 INFO:teuthology.orchestra.run.smithi138.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.8 MB/s | 457 kB 00:00 2024-02-19T21:47:53.456 INFO:teuthology.orchestra.run.smithi138.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.2 MB/s | 249 kB 00:00 2024-02-19T21:47:53.498 INFO:teuthology.orchestra.run.smithi138.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 2.6 MB/s | 109 kB 00:00 2024-02-19T21:47:53.523 INFO:teuthology.orchestra.run.smithi138.stdout:(13/32): python3-cryptography-3.2.1-7.el8.x86_6 4.4 MB/s | 641 kB 00:00 2024-02-19T21:47:53.798 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:47:53.844 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:47:53.845 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-02-19T21:47:53.845 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:47:53.865 INFO:teuthology.orchestra.run.smithi138.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 119 kB/s | 44 kB 00:00 2024-02-19T21:47:53.936 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rbd 2024-02-19T21:47:53.982 INFO:teuthology.orchestra.run.smithi138.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 404 kB/s | 185 kB 00:00 2024-02-19T21:47:54.316 INFO:teuthology.orchestra.run.smithi138.stdout:(16/32): ceph-osd-16.2.14-548.g81bd20d6.el8.x86 12 MB/s | 19 MB 00:01 2024-02-19T21:47:54.349 INFO:teuthology.orchestra.run.smithi138.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 357 kB/s | 173 kB 00:00 2024-02-19T21:47:54.375 INFO:teuthology.orchestra.run.smithi138.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 980 kB/s | 384 kB 00:00 2024-02-19T21:47:54.434 INFO:teuthology.orchestra.run.smithi138.stdout:(19/32): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2024-02-19T21:47:54.492 INFO:teuthology.orchestra.run.smithi138.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 416 kB/s | 49 kB 00:00 2024-02-19T21:47:54.568 INFO:teuthology.orchestra.run.smithi138.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 439 kB/s | 59 kB 00:00 2024-02-19T21:47:54.660 INFO:teuthology.orchestra.run.smithi138.stdout:(22/32): python3-jaraco-functools-2.0-4.el8.noa 57 kB/s | 18 kB 00:00 2024-02-19T21:47:54.685 INFO:teuthology.orchestra.run.smithi138.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2024-02-19T21:47:54.686 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:37 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:47:54.744 INFO:teuthology.orchestra.run.smithi138.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.1 MB/s | 283 kB 00:00 2024-02-19T21:47:54.989 INFO:teuthology.orchestra.run.smithi138.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 57 kB/s | 19 kB 00:00 2024-02-19T21:47:55.170 INFO:teuthology.orchestra.run.smithi138.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 49 kB/s | 24 kB 00:00 2024-02-19T21:47:55.195 INFO:teuthology.orchestra.run.smithi138.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 65 kB/s | 29 kB 00:00 2024-02-19T21:47:55.221 INFO:teuthology.orchestra.run.smithi138.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 119 kB/s | 27 kB 00:00 2024-02-19T21:47:55.404 INFO:teuthology.orchestra.run.smithi138.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.2 MB/s | 255 kB 00:00 2024-02-19T21:47:55.421 INFO:teuthology.orchestra.run.smithi138.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 426 kB/s | 85 kB 00:00 2024-02-19T21:47:55.530 INFO:teuthology.orchestra.run.smithi138.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 183 kB/s | 23 kB 00:00 2024-02-19T21:47:55.555 INFO:teuthology.orchestra.run.smithi138.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 699 kB/s | 251 kB 00:00 2024-02-19T21:47:55.557 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:47:55.557 INFO:teuthology.orchestra.run.smithi138.stdout:Total 8.1 MB/s | 32 MB 00:03 2024-02-19T21:47:55.638 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:47:55.677 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:47:55.677 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:47:56.014 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:47:56.017 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:47:56.177 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:47:56.222 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:47:56.224 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-02-19T21:47:56.224 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:47:56.327 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-fuse 2024-02-19T21:47:57.077 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:40 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:47:57.162 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:47:57.420 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-19T21:47:57.706 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-19T21:47:57.857 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-19T21:47:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-19T21:47:58.344 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-19T21:47:58.508 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-19T21:47:58.639 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:47:58.640 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:58.640 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-02-19T21:47:58.640 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:58.640 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:47:58.640 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 88 k 2024-02-19T21:47:58.640 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:58.640 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:47:58.640 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:47:58.640 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-02-19T21:47:58.640 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:47:58.640 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 88 k 2024-02-19T21:47:58.641 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 240 k 2024-02-19T21:47:58.641 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:47:58.717 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-19T21:47:58.978 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-19T21:47:59.028 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-fuse-16.2.14-548.g81bd20d6.el8.x86_64.rpm 228 kB/s | 88 kB 00:00 2024-02-19T21:47:59.029 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:47:59.029 INFO:teuthology.orchestra.run.smithi099.stdout:Total 227 kB/s | 88 kB 00:00 2024-02-19T21:47:59.030 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:47:59.040 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:47:59.040 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:47:59.093 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:47:59.096 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:47:59.172 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-19T21:47:59.204 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:47:59.379 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:47:59.426 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-19T21:47:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:47:59.688 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-19T21:47:59.936 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-19T21:48:00.016 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:48:00.016 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:48:00.016 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:48:00.016 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:48:00.016 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:48:00.016 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:48:00.240 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-mirror 2024-02-19T21:48:00.310 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-19T21:48:00.583 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-19T21:48:00.805 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-19T21:48:01.003 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:44 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:48:01.072 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-19T21:48:01.309 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-19T21:48:01.640 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-19T21:48:01.836 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-19T21:48:02.066 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-19T21:48:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-19T21:48:02.539 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:48:02.539 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:48:02.539 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-02-19T21:48:02.540 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:48:02.540 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:48:02.540 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 3.7 M 2024-02-19T21:48:02.540 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:48:02.540 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:48:02.541 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:48:02.541 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-02-19T21:48:02.541 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:48:02.541 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 3.7 M 2024-02-19T21:48:02.541 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 15 M 2024-02-19T21:48:02.541 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:48:02.550 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-19T21:48:02.744 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-19T21:48:02.985 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-19T21:48:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-19T21:48:03.708 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-19T21:48:03.948 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-mirror-16.2.14-548.g81bd20d6.el8.x86_64.rpm 2.6 MB/s | 3.7 MB 00:01 2024-02-19T21:48:03.949 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:48:03.949 INFO:teuthology.orchestra.run.smithi099.stdout:Total 2.6 MB/s | 3.7 MB 00:01 2024-02-19T21:48:03.950 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:48:03.962 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:48:03.962 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:48:04.028 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:48:04.031 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:48:04.107 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-548.g81bd20d6.el8. 27/32 2024-02-19T21:48:04.313 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 28/32 2024-02-19T21:48:04.475 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:48:04.641 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:48:05.067 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:48:05.419 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:48:05.419 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:48:05.419 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:48:05.420 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:48:05.420 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:48:05.420 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:48:05.613 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-nbd 2024-02-19T21:48:05.835 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 28/32 2024-02-19T21:48:06.005 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 29/32 2024-02-19T21:48:06.386 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:49 ago on Mon 19 Feb 2024 09:45:17 PM UTC. 2024-02-19T21:48:06.460 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 29/32 2024-02-19T21:48:06.647 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 30/32 2024-02-19T21:48:06.864 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 30/32 2024-02-19T21:48:07.038 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 31/32 2024-02-19T21:48:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 31/32 2024-02-19T21:48:07.163 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 32/32 2024-02-19T21:48:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 32/32 2024-02-19T21:48:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 1/32 2024-02-19T21:48:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 2/32 2024-02-19T21:48:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 3/32 2024-02-19T21:48:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 4/32 2024-02-19T21:48:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 5/32 2024-02-19T21:48:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-548.g81bd20d6.el8. 6/32 2024-02-19T21:48:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-19T21:48:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-19T21:48:07.572 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-19T21:48:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-19T21:48:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-19T21:48:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-19T21:48:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-19T21:48:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-19T21:48:07.574 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-19T21:48:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-19T21:48:07.575 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-19T21:48:07.920 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-19T21:48:07.921 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:48:07.921 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-02-19T21:48:07.921 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:48:07.921 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-19T21:48:07.922 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 175 k 2024-02-19T21:48:07.922 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:48:07.922 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-19T21:48:07.922 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-19T21:48:07.922 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-02-19T21:48:07.922 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:48:07.922 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 175 k 2024-02-19T21:48:07.922 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 523 k 2024-02-19T21:48:07.923 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-19T21:48:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-nbd-16.2.14-548.g81bd20d6.el8.x86_64.rpm 425 kB/s | 175 kB 00:00 2024-02-19T21:48:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:48:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:Total 424 kB/s | 175 kB 00:00 2024-02-19T21:48:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-19T21:48:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-19T21:48:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-19T21:48:08.397 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-19T21:48:08.400 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-19T21:48:08.414 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-19T21:48:08.415 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:08.415 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:48:08.415 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:48:08.415 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:48:08.415 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:48:08.415 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:48:08.415 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:48:08.415 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:48:08.415 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-19T21:48:08.415 INFO:teuthology.orchestra.run.smithi138.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-19T21:48:08.415 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-19T21:48:08.415 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-19T21:48:08.415 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-19T21:48:08.415 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-19T21:48:08.416 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-19T21:48:08.416 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-19T21:48:08.416 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-19T21:48:08.416 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-19T21:48:08.416 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-19T21:48:08.416 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-19T21:48:08.416 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-19T21:48:08.416 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend-2.6-1.el8.noarch 2024-02-19T21:48:08.416 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-19T21:48:08.416 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-19T21:48:08.416 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-19T21:48:08.416 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-19T21:48:08.416 INFO:teuthology.orchestra.run.smithi138.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-19T21:48:08.417 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-19T21:48:08.417 INFO:teuthology.orchestra.run.smithi138.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-19T21:48:08.417 INFO:teuthology.orchestra.run.smithi138.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-19T21:48:08.417 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-19T21:48:08.417 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-19T21:48:08.417 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-19T21:48:08.417 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-19T21:48:08.417 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:08.417 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:48:08.519 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-19T21:48:08.718 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:48:08.739 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-base 2024-02-19T21:48:09.015 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:48:09.494 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:29 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:48:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:48:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:48:09.534 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-19T21:48:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:48:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:48:09.534 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-19T21:48:09.749 DEBUG:teuthology.parallel:result is None 2024-02-19T21:48:10.978 INFO:teuthology.orchestra.run.smithi138.stdout:Package ceph-base-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:48:11.024 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:48:11.025 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-19T21:48:11.025 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:48:11.132 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install cephadm 2024-02-19T21:48:11.885 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:31 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:48:13.428 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:48:13.429 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:48:13.429 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-19T21:48:13.429 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:48:13.429 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:48:13.429 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 85 k 2024-02-19T21:48:13.429 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:13.429 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:48:13.429 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:48:13.429 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-19T21:48:13.429 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:13.429 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 85 k 2024-02-19T21:48:13.430 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 352 k 2024-02-19T21:48:13.430 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:48:13.588 INFO:teuthology.orchestra.run.smithi138.stdout:cephadm-16.2.14-548.g81bd20d6.el8.noarch.rpm 537 kB/s | 85 kB 00:00 2024-02-19T21:48:13.589 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:48:13.589 INFO:teuthology.orchestra.run.smithi138.stdout:Total 533 kB/s | 85 kB 00:00 2024-02-19T21:48:13.589 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:48:13.596 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:48:13.596 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:48:13.598 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:48:13.601 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:48:13.648 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:48:14.177 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:48:14.324 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:48:14.550 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:48:14.938 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/1 2024-02-19T21:48:14.938 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:14.939 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:48:14.939 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:48:14.939 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:14.939 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:48:15.179 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-immutable-object-cache 2024-02-19T21:48:15.941 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:35 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:48:17.500 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:48:17.501 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:48:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-02-19T21:48:17.501 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:48:17.501 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:48:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 161 k 2024-02-19T21:48:17.501 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:17.501 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:48:17.501 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:48:17.501 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-19T21:48:17.502 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:17.502 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 161 k 2024-02-19T21:48:17.502 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 470 k 2024-02-19T21:48:17.502 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:48:17.697 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-immutable-object-cache-16.2.14-548.g81bd20 830 kB/s | 161 kB 00:00 2024-02-19T21:48:17.697 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:48:17.698 INFO:teuthology.orchestra.run.smithi138.stdout:Total 824 kB/s | 161 kB 00:00 2024-02-19T21:48:17.698 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:48:17.709 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:48:17.709 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:48:17.756 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:48:17.759 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:48:17.869 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:48:18.037 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6. 1/1 2024-02-19T21:48:18.436 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6. 1/1 2024-02-19T21:48:18.828 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6. 1/1 2024-02-19T21:48:18.828 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:18.828 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:48:18.828 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:48:18.828 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:18.828 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:48:19.055 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr 2024-02-19T21:48:19.823 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:39 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:48:21.331 INFO:teuthology.orchestra.run.smithi138.stdout:Package ceph-mgr-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:48:21.377 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:48:21.379 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-19T21:48:21.379 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:48:21.504 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-dashboard 2024-02-19T21:48:22.255 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:42 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:48:23.801 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:48:23.802 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:48:23.802 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-19T21:48:23.802 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:48:23.803 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:48:23.803 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 3.1 M 2024-02-19T21:48:23.803 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-19T21:48:23.803 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 24 k 2024-02-19T21:48:23.803 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 15 k 2024-02-19T21:48:23.803 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-02-19T21:48:23.803 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-02-19T21:48:23.803 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-02-19T21:48:23.803 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:23.803 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:48:23.803 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:48:23.803 INFO:teuthology.orchestra.run.smithi138.stdout:Install 6 Packages 2024-02-19T21:48:23.803 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:23.804 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 3.4 M 2024-02-19T21:48:23.804 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 22 M 2024-02-19T21:48:23.804 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:48:24.162 INFO:teuthology.orchestra.run.smithi138.stdout:(1/6): ceph-grafana-dashboards-16.2.14-548.g81b 168 kB/s | 24 kB 00:00 2024-02-19T21:48:24.187 INFO:teuthology.orchestra.run.smithi138.stdout:(2/6): ceph-prometheus-alerts-16.2.14-548.g81bd 88 kB/s | 15 kB 00:00 2024-02-19T21:48:24.254 INFO:teuthology.orchestra.run.smithi138.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 463 kB/s | 43 kB 00:00 2024-02-19T21:48:24.438 INFO:teuthology.orchestra.run.smithi138.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 134 kB/s | 34 kB 00:00 2024-02-19T21:48:24.629 INFO:teuthology.orchestra.run.smithi138.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 530 kB/s | 196 kB 00:00 2024-02-19T21:48:24.938 INFO:teuthology.orchestra.run.smithi138.stdout:(6/6): ceph-mgr-dashboard-16.2.14-548.g81bd20d6 3.4 MB/s | 3.1 MB 00:00 2024-02-19T21:48:24.941 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:48:24.942 INFO:teuthology.orchestra.run.smithi138.stdout:Total 3.0 MB/s | 3.4 MB 00:01 2024-02-19T21:48:24.953 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:48:24.964 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:48:24.964 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:48:25.125 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:48:25.128 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:48:25.432 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:48:25.650 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-02-19T21:48:25.878 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-02-19T21:48:26.079 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-02-19T21:48:26.258 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-548.g81bd20d6.el8.n 4/6 2024-02-19T21:48:27.280 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-548.g81bd20d6.el8. 5/6 2024-02-19T21:48:27.584 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarc 6/6 2024-02-19T21:48:27.859 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarc 6/6 2024-02-19T21:48:27.859 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-548.g81bd20d6.el8. 1/6 2024-02-19T21:48:27.859 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarc 2/6 2024-02-19T21:48:27.859 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-548.g81bd20d6.el8.n 3/6 2024-02-19T21:48:27.860 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-02-19T21:48:27.860 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-02-19T21:48:28.272 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-02-19T21:48:28.272 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:28.272 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:48:28.273 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:48:28.273 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:48:28.273 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:48:28.273 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-02-19T21:48:28.273 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-02-19T21:48:28.273 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes-2.4.1-12.el8.noarch 2024-02-19T21:48:28.273 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:28.273 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:48:28.400 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-19T21:48:29.153 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:49 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:48:30.699 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:48:30.700 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================================ 2024-02-19T21:48:30.700 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-19T21:48:30.700 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================================ 2024-02-19T21:48:30.700 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:48:30.700 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 8.6 M 2024-02-19T21:48:30.701 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-19T21:48:30.701 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-02-19T21:48:30.701 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-02-19T21:48:30.701 INFO:teuthology.orchestra.run.smithi138.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-02-19T21:48:30.701 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-02-19T21:48:30.701 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-02-19T21:48:30.701 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-02-19T21:48:30.701 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-02-19T21:48:30.701 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:30.701 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:48:30.701 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================================ 2024-02-19T21:48:30.701 INFO:teuthology.orchestra.run.smithi138.stdout:Install 8 Packages 2024-02-19T21:48:30.701 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:30.702 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 37 M 2024-02-19T21:48:30.702 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 210 M 2024-02-19T21:48:30.702 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:48:31.895 INFO:teuthology.orchestra.run.smithi138.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.14-54 11 MB/s | 8.6 MB 00:00 2024-02-19T21:48:34.522 INFO:teuthology.orchestra.run.smithi138.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 1.4 MB/s | 4.7 MB 00:03 2024-02-19T21:48:34.822 INFO:teuthology.orchestra.run.smithi138.stdout:(3/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 1.3 MB/s | 4.9 MB 00:03 2024-02-19T21:48:34.847 INFO:teuthology.orchestra.run.smithi138.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 692 kB/s | 225 kB 00:00 2024-02-19T21:48:35.098 INFO:teuthology.orchestra.run.smithi138.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 2.5 MB/s | 645 kB 00:00 2024-02-19T21:48:35.165 INFO:teuthology.orchestra.run.smithi138.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 2.5 MB/s | 172 kB 00:00 2024-02-19T21:48:35.573 INFO:teuthology.orchestra.run.smithi138.stdout:(7/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 1.0 MB/s | 3.7 MB 00:03 2024-02-19T21:48:46.066 INFO:teuthology.orchestra.run.smithi138.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 1.3 MB/s | 14 MB 00:11 2024-02-19T21:48:46.066 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:48:46.067 INFO:teuthology.orchestra.run.smithi138.stdout:Total 2.4 MB/s | 37 MB 00:15 2024-02-19T21:48:46.299 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:48:46.317 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:48:46.317 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:48:46.655 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:48:46.658 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:48:47.222 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:48:47.406 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-19T21:48:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-19T21:48:47.723 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-19T21:48:48.322 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-19T21:48:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-02-19T21:48:49.149 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-02-19T21:48:49.356 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-19T21:48:50.039 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-19T21:48:50.393 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-02-19T21:48:50.665 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-19T21:48:52.432 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-19T21:48:53.727 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-02-19T21:48:53.922 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d 8/8 2024-02-19T21:48:54.229 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d 8/8 2024-02-19T21:48:54.230 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d 1/8 2024-02-19T21:48:54.230 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-02-19T21:48:54.230 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-02-19T21:48:54.230 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-02-19T21:48:54.230 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-02-19T21:48:54.230 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-02-19T21:48:54.230 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-02-19T21:48:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-02-19T21:48:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:54.621 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:48:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:48:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-02-19T21:48:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-02-19T21:48:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-0.3.15-4.el8.x86_64 2024-02-19T21:48:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-02-19T21:48:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-02-19T21:48:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-02-19T21:48:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-02-19T21:48:54.622 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:54.622 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:48:54.778 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-rook 2024-02-19T21:48:55.529 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:15 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:48:57.101 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:48:57.103 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:48:57.103 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-19T21:48:57.103 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:48:57.103 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:48:57.103 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 27 k 2024-02-19T21:48:57.103 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-19T21:48:57.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-02-19T21:48:57.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-02-19T21:48:57.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-02-19T21:48:57.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-02-19T21:48:57.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-02-19T21:48:57.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-02-19T21:48:57.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-02-19T21:48:57.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-02-19T21:48:57.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-02-19T21:48:57.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-02-19T21:48:57.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-02-19T21:48:57.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-02-19T21:48:57.104 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:57.104 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:48:57.104 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:48:57.104 INFO:teuthology.orchestra.run.smithi138.stdout:Install 13 Packages 2024-02-19T21:48:57.104 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:48:57.105 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 1.9 M 2024-02-19T21:48:57.105 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 24 M 2024-02-19T21:48:57.105 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:48:57.610 INFO:teuthology.orchestra.run.smithi138.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 395 kB/s | 27 kB 00:00 2024-02-19T21:48:57.643 INFO:teuthology.orchestra.run.smithi138.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 198 kB/s | 20 kB 00:00 2024-02-19T21:48:57.677 INFO:teuthology.orchestra.run.smithi138.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.8 MB/s | 126 kB 00:00 2024-02-19T21:48:57.719 INFO:teuthology.orchestra.run.smithi138.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.5 MB/s | 110 kB 00:00 2024-02-19T21:48:57.752 INFO:teuthology.orchestra.run.smithi138.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 2.0 MB/s | 155 kB 00:00 2024-02-19T21:48:57.803 INFO:teuthology.orchestra.run.smithi138.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 509 kB/s | 43 kB 00:00 2024-02-19T21:48:57.912 INFO:teuthology.orchestra.run.smithi138.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 208 kB/s | 33 kB 00:00 2024-02-19T21:48:57.937 INFO:teuthology.orchestra.run.smithi138.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 122 kB/s | 16 kB 00:00 2024-02-19T21:48:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:(9/13): ceph-mgr-rook-16.2.14-548.g81bd20d6.el8 63 kB/s | 27 kB 00:00 2024-02-19T21:48:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 880 kB/s | 81 kB 00:00 2024-02-19T21:48:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 1.1 MB/s | 61 kB 00:00 2024-02-19T21:48:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:(12/13): python3-kubernetes-11.0.0-6.el8.noarch 6.1 MB/s | 1.2 MB 00:00 2024-02-19T21:48:58.155 INFO:teuthology.orchestra.run.smithi138.stdout:(13/13): python3-rsa-4.9-2.el8.noarch.rpm 365 kB/s | 64 kB 00:00 2024-02-19T21:48:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:48:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:Total 1.8 MB/s | 1.9 MB 00:01 2024-02-19T21:48:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:48:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:48:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:48:58.313 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:48:58.316 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:48:58.834 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:48:59.123 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-02-19T21:48:59.371 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-02-19T21:48:59.615 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-02-19T21:49:00.278 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-02-19T21:49:00.545 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-02-19T21:49:00.781 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-02-19T21:49:01.112 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-02-19T21:49:01.377 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-02-19T21:49:02.451 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-02-19T21:49:02.727 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-02-19T21:49:02.961 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-02-19T21:49:03.161 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-02-19T21:49:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 13/13 2024-02-19T21:49:03.655 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 13/13 2024-02-19T21:49:03.656 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 1/13 2024-02-19T21:49:03.656 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-02-19T21:49:03.656 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-02-19T21:49:03.656 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-02-19T21:49:03.656 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-02-19T21:49:03.656 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-02-19T21:49:03.656 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-02-19T21:49:03.656 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-02-19T21:49:03.656 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-02-19T21:49:03.656 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-02-19T21:49:03.656 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-02-19T21:49:03.656 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-02-19T21:49:04.171 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-02-19T21:49:04.172 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:04.172 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:49:04.172 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:49:04.172 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-02-19T21:49:04.172 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-02-19T21:49:04.172 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-02-19T21:49:04.172 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-02-19T21:49:04.172 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-02-19T21:49:04.172 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-02-19T21:49:04.172 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-02-19T21:49:04.172 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-02-19T21:49:04.172 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-02-19T21:49:04.173 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-02-19T21:49:04.173 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa-4.9-2.el8.noarch 2024-02-19T21:49:04.173 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-02-19T21:49:04.173 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:04.173 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:04.297 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-cephadm 2024-02-19T21:49:05.050 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:25 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:49:06.607 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:49:06.607 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:06.608 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-19T21:49:06.608 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:06.608 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:49:06.608 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm noarch 2:16.2.14-548.g81bd20d6.el8 ceph-noarch 116 k 2024-02-19T21:49:06.608 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-19T21:49:06.608 INFO:teuthology.orchestra.run.smithi138.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-02-19T21:49:06.608 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-02-19T21:49:06.608 INFO:teuthology.orchestra.run.smithi138.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-02-19T21:49:06.608 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-02-19T21:49:06.608 INFO:teuthology.orchestra.run.smithi138.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-02-19T21:49:06.608 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:06.608 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:49:06.608 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:06.609 INFO:teuthology.orchestra.run.smithi138.stdout:Install 6 Packages 2024-02-19T21:49:06.609 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:06.609 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 5.9 M 2024-02-19T21:49:06.609 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 24 M 2024-02-19T21:49:06.609 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:49:08.086 INFO:teuthology.orchestra.run.smithi138.stdout:(1/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 4.1 MB/s | 578 kB 00:00 2024-02-19T21:49:08.370 INFO:teuthology.orchestra.run.smithi138.stdout:(2/6): ceph-mgr-cephadm-16.2.14-548.g81bd20d6.e 276 kB/s | 116 kB 00:00 2024-02-19T21:49:08.437 INFO:teuthology.orchestra.run.smithi138.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 60 kB/s | 21 kB 00:00 2024-02-19T21:49:08.621 INFO:teuthology.orchestra.run.smithi138.stdout:(4/6): python3-babel-2.5.1-7.el8.noarch.rpm 7.1 MB/s | 4.8 MB 00:00 2024-02-19T21:49:08.637 INFO:teuthology.orchestra.run.smithi138.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 244 kB/s | 49 kB 00:00 2024-02-19T21:49:09.096 INFO:teuthology.orchestra.run.smithi138.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 490 kB/s | 355 kB 00:00 2024-02-19T21:49:09.098 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:49:09.098 INFO:teuthology.orchestra.run.smithi138.stdout:Total 2.4 MB/s | 5.9 MB 00:02 2024-02-19T21:49:09.151 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:49:09.161 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:49:09.162 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:49:09.267 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:49:09.270 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:49:09.594 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:49:09.852 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-02-19T21:49:10.105 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-02-19T21:49:11.064 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-02-19T21:49:11.473 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-02-19T21:49:11.762 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-02-19T21:49:11.986 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 6/6 2024-02-19T21:49:12.275 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 6/6 2024-02-19T21:49:12.275 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 1/6 2024-02-19T21:49:12.275 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-02-19T21:49:12.275 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-02-19T21:49:12.275 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-02-19T21:49:12.275 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-02-19T21:49:12.661 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-02-19T21:49:12.661 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:12.661 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:49:12.661 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm-2:16.2.14-548.g81bd20d6.el8.noarch 2024-02-19T21:49:12.661 INFO:teuthology.orchestra.run.smithi138.stdout: python3-apipkg-1.5-6.el8.noarch 2024-02-19T21:49:12.661 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel-2.5.1-7.el8.noarch 2024-02-19T21:49:12.661 INFO:teuthology.orchestra.run.smithi138.stdout: python3-execnet-1.7.1-1.el8.noarch 2024-02-19T21:49:12.661 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-02-19T21:49:12.661 INFO:teuthology.orchestra.run.smithi138.stdout: python3-remoto-1.2.1-1.el8.noarch 2024-02-19T21:49:12.662 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:12.662 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:12.767 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-fuse 2024-02-19T21:49:13.522 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:33 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:49:15.058 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:49:15.058 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:15.058 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-19T21:49:15.059 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:15.059 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:49:15.059 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 911 k 2024-02-19T21:49:15.059 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-19T21:49:15.059 INFO:teuthology.orchestra.run.smithi138.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-19T21:49:15.059 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:15.059 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:49:15.059 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:15.059 INFO:teuthology.orchestra.run.smithi138.stdout:Install 2 Packages 2024-02-19T21:49:15.059 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:15.060 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 994 k 2024-02-19T21:49:15.060 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 2.8 M 2024-02-19T21:49:15.060 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:49:15.208 INFO:teuthology.orchestra.run.smithi138.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 852 kB/s | 83 kB 00:00 2024-02-19T21:49:17.458 INFO:teuthology.orchestra.run.smithi138.stdout:(2/2): ceph-fuse-16.2.14-548.g81bd20d6.el8.x86_ 388 kB/s | 911 kB 00:02 2024-02-19T21:49:17.458 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:49:17.459 INFO:teuthology.orchestra.run.smithi138.stdout:Total 414 kB/s | 994 kB 00:02 2024-02-19T21:49:17.471 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:49:17.493 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:49:17.493 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:49:17.586 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:49:17.589 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:49:17.752 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:49:18.067 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-19T21:49:18.294 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 2/2 2024-02-19T21:49:18.678 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 2/2 2024-02-19T21:49:18.679 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/2 2024-02-19T21:49:19.069 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-19T21:49:19.069 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:19.069 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:49:19.069 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-19T21:49:19.069 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:19.069 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:19.344 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librados-devel 2024-02-19T21:49:20.224 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:40 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:49:21.768 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:49:21.769 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:21.769 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-02-19T21:49:21.769 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:21.769 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:49:21.769 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 131 k 2024-02-19T21:49:21.769 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:21.769 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:49:21.769 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:21.769 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-19T21:49:21.769 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:21.769 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 131 k 2024-02-19T21:49:21.769 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 432 k 2024-02-19T21:49:21.770 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:49:22.484 INFO:teuthology.orchestra.run.smithi138.stdout:librados-devel-16.2.14-548.g81bd20d6.el8.x86_64 183 kB/s | 131 kB 00:00 2024-02-19T21:49:22.485 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:49:22.485 INFO:teuthology.orchestra.run.smithi138.stdout:Total 183 kB/s | 131 kB 00:00 2024-02-19T21:49:22.485 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:49:22.491 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:49:22.491 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:49:22.546 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:49:22.549 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:49:22.665 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:49:22.942 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:23.234 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:23.611 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:23.611 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:23.611 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:49:23.611 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:49:23.611 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:23.612 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:23.817 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install libcephfs2 2024-02-19T21:49:24.590 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:44 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:49:26.095 INFO:teuthology.orchestra.run.smithi138.stdout:Package libcephfs2-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:49:26.140 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:49:26.141 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-19T21:49:26.141 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:26.232 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install libcephfs-devel 2024-02-19T21:49:26.988 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:46 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:49:28.549 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:49:28.550 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:28.550 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-02-19T21:49:28.550 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:28.550 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:49:28.550 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 25 k 2024-02-19T21:49:28.550 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:28.550 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:49:28.550 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:28.550 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-19T21:49:28.551 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:28.551 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 25 k 2024-02-19T21:49:28.551 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 107 k 2024-02-19T21:49:28.551 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:49:28.950 INFO:teuthology.orchestra.run.smithi138.stdout:libcephfs-devel-16.2.14-548.g81bd20d6.el8.x86_6 64 kB/s | 25 kB 00:00 2024-02-19T21:49:28.950 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:49:28.950 INFO:teuthology.orchestra.run.smithi138.stdout:Total 64 kB/s | 25 kB 00:00 2024-02-19T21:49:28.951 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:49:28.954 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:49:28.954 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:49:28.956 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:49:28.960 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:49:29.036 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:49:29.248 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:29.551 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:29.890 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:29.890 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:29.890 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:49:29.890 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:49:29.890 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:29.890 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:30.032 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librados2 2024-02-19T21:49:30.784 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:50 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:49:32.285 INFO:teuthology.orchestra.run.smithi138.stdout:Package librados2-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:49:32.331 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:49:32.332 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-19T21:49:32.332 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:32.432 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librbd1 2024-02-19T21:49:33.189 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:53 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:49:34.699 INFO:teuthology.orchestra.run.smithi138.stdout:Package librbd1-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:49:34.899 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:49:34.899 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-19T21:49:34.899 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:34.899 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rados 2024-02-19T21:49:35.667 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:55 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:49:37.276 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rados-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:49:37.323 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:49:37.324 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-19T21:49:37.324 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:37.431 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rgw 2024-02-19T21:49:38.181 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:58 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:49:39.663 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rgw-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:49:39.707 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:49:39.709 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-19T21:49:39.709 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:39.808 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-cephfs 2024-02-19T21:49:40.563 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:00 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:49:42.068 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-cephfs-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:49:42.116 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:49:42.117 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-19T21:49:42.117 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:42.231 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rbd 2024-02-19T21:49:42.984 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:02 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:49:44.487 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rbd-2:16.2.14-548.g81bd20d6.el8.x86_64 is already installed. 2024-02-19T21:49:44.533 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:49:44.534 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-19T21:49:44.534 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:44.630 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-fuse 2024-02-19T21:49:45.383 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:05 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:49:46.941 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:49:46.942 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:46.942 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-02-19T21:49:46.942 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:46.942 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:49:46.942 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 88 k 2024-02-19T21:49:46.942 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:46.942 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:49:46.942 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:46.943 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-19T21:49:46.943 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:46.943 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 88 k 2024-02-19T21:49:46.943 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 240 k 2024-02-19T21:49:46.943 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:49:47.192 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-fuse-16.2.14-548.g81bd20d6.el8.x86_64.rpm 355 kB/s | 88 kB 00:00 2024-02-19T21:49:47.192 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:49:47.192 INFO:teuthology.orchestra.run.smithi138.stdout:Total 353 kB/s | 88 kB 00:00 2024-02-19T21:49:47.193 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:49:47.202 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:49:47.202 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:49:47.251 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:49:47.254 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:49:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:49:47.563 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:47.896 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:48.349 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:48.349 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:48.349 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:49:48.349 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:49:48.349 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:48.349 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:48.557 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-mirror 2024-02-19T21:49:49.327 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:09 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:49:50.881 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:49:50.882 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:50.882 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-02-19T21:49:50.882 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:50.882 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:49:50.882 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 3.7 M 2024-02-19T21:49:50.882 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:50.882 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:49:50.883 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:50.883 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-19T21:49:50.883 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:50.883 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 3.7 M 2024-02-19T21:49:50.883 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 15 M 2024-02-19T21:49:50.883 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:49:52.875 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-mirror-16.2.14-548.g81bd20d6.el8.x86_64.rpm 1.8 MB/s | 3.7 MB 00:01 2024-02-19T21:49:52.875 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:49:52.876 INFO:teuthology.orchestra.run.smithi138.stdout:Total 1.8 MB/s | 3.7 MB 00:01 2024-02-19T21:49:52.876 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:49:52.886 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:49:52.886 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:49:52.953 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:49:52.956 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:49:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:49:53.580 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:54.002 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:54.679 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:54.679 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:54.679 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:49:54.680 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:49:54.680 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:54.680 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:54.893 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-nbd 2024-02-19T21:49:55.664 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:15 ago on Mon 19 Feb 2024 09:46:40 PM UTC. 2024-02-19T21:49:57.181 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-19T21:49:57.181 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-02-19T21:49:57.182 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:57.182 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-19T21:49:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd x86_64 2:16.2.14-548.g81bd20d6.el8 ceph 175 k 2024-02-19T21:49:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:57.182 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-19T21:49:57.182 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-19T21:49:57.182 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-19T21:49:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:57.183 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 175 k 2024-02-19T21:49:57.183 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 523 k 2024-02-19T21:49:57.183 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-19T21:49:57.652 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-nbd-16.2.14-548.g81bd20d6.el8.x86_64.rpm 373 kB/s | 175 kB 00:00 2024-02-19T21:49:57.653 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-19T21:49:57.653 INFO:teuthology.orchestra.run.smithi138.stdout:Total 372 kB/s | 175 kB 00:00 2024-02-19T21:49:57.653 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-19T21:49:57.664 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-19T21:49:57.664 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-19T21:49:57.713 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-19T21:49:57.716 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-19T21:49:57.826 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-19T21:49:58.061 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:58.354 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:58.749 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 1/1 2024-02-19T21:49:58.749 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:58.749 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-19T21:49:58.749 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd-2:16.2.14-548.g81bd20d6.el8.x86_64 2024-02-19T21:49:58.749 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:49:58.749 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-19T21:49:59.031 DEBUG:teuthology.parallel:result is None 2024-02-19T21:49:59.032 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:49:59.256 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-19T21:49:59.283 INFO:teuthology.orchestra.run.smithi099.stdout:16.2.14-548.g81bd20d6.el8 2024-02-19T21:49:59.284 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-548.g81bd20d6.el8 2024-02-19T21:49:59.284 INFO:teuthology.task.install:The correct ceph version 16.2.14-548.g81bd20d6 is installed. 2024-02-19T21:49:59.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:49:59.500 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-19T21:49:59.524 INFO:teuthology.orchestra.run.smithi138.stdout:16.2.14-548.g81bd20d6.el8 2024-02-19T21:49:59.524 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-548.g81bd20d6.el8 2024-02-19T21:49:59.524 INFO:teuthology.task.install:The correct ceph version 16.2.14-548.g81bd20d6 is installed. 2024-02-19T21:49:59.526 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-19T21:49:59.526 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:49:59.526 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-19T21:49:59.560 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-19T21:49:59.560 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-19T21:49:59.593 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-19T21:49:59.594 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:49:59.594 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-02-19T21:49:59.631 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-19T21:49:59.699 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-19T21:49:59.700 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-02-19T21:49:59.727 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-19T21:49:59.794 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-19T21:49:59.794 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:49:59.794 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-19T21:49:59.822 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-19T21:49:59.890 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-19T21:49:59.890 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-19T21:49:59.917 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-19T21:49:59.984 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-19T21:49:59.984 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:49:59.984 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-02-19T21:50:00.013 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-19T21:50:00.082 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-19T21:50:00.083 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-02-19T21:50:00.110 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-19T21:50:00.177 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-19T21:50:00.247 INFO:tasks.cephadm:Config: {'roleless': True, 'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '81bd20d634209c7cb82c18be12b4b5a05643ebf1'} 2024-02-19T21:50:00.247 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:50:00.247 INFO:tasks.cephadm:Cluster fsid is d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:50:00.247 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-19T21:50:00.248 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-19T21:50:00.248 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi099': '172.21.15.99', 'mon.smithi138': '172.21.15.138'} 2024-02-19T21:50:00.248 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-19T21:50:00.248 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname $(hostname -s) 2024-02-19T21:50:00.276 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname $(hostname -s) 2024-02-19T21:50:00.303 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph-ci.git ref 81bd20d634209c7cb82c18be12b4b5a05643ebf1)... 2024-02-19T21:50:00.303 DEBUG:teuthology.orchestra.run.smithi099:> curl --silent https://raw.githubusercontent.com/ceph/ceph-ci/81bd20d634209c7cb82c18be12b4b5a05643ebf1/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-19T21:50:00.508 INFO:teuthology.orchestra.run.smithi099.stdout:-rw-rw-r--. 1 ubuntu ubuntu 355729 Feb 19 21:50 /home/ubuntu/cephtest/cephadm 2024-02-19T21:50:00.508 DEBUG:teuthology.orchestra.run.smithi138:> curl --silent https://raw.githubusercontent.com/ceph/ceph-ci/81bd20d634209c7cb82c18be12b4b5a05643ebf1/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-19T21:50:00.685 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-rw-r--. 1 ubuntu ubuntu 355729 Feb 19 21:50 /home/ubuntu/cephtest/cephadm 2024-02-19T21:50:00.685 DEBUG:teuthology.orchestra.run.smithi099:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-19T21:50:00.704 DEBUG:teuthology.orchestra.run.smithi138:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-19T21:50:00.732 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph 2024-02-19T21:50:00.772 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph 2024-02-19T21:50:00.798 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /etc/ceph 2024-02-19T21:50:00.837 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /etc/ceph 2024-02-19T21:50:00.864 INFO:tasks.cephadm:Writing seed config... 2024-02-19T21:50:00.866 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-19T21:50:00.866 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-19T21:50:00.866 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-19T21:50:00.866 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-19T21:50:00.866 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-19T21:50:00.866 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-19T21:50:00.866 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-19T21:50:00.866 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-02-19T21:50:00.867 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:50:00.867 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-19T21:50:00.895 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d4704266-cf70-11ee-95bb-87774f69a715 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-02-19T21:50:00.895 DEBUG:teuthology.orchestra.run.smithi099:mon.smithi099> sudo journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@mon.smithi099.service 2024-02-19T21:50:00.937 INFO:tasks.cephadm:Bootstrapping... 2024-02-19T21:50:00.937 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 -v bootstrap --fsid d4704266-cf70-11ee-95bb-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.99 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-19T21:50:00.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:-- Logs begin at Mon 2024-02-19 21:38:19 UTC. -- 2024-02-19T21:50:01.208 INFO:teuthology.orchestra.run.smithi099.stderr:-------------------------------------------------------------------------------- 2024-02-19T21:50:01.208 INFO:teuthology.orchestra.run.smithi099.stderr:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1', '-v', 'bootstrap', '--fsid', 'd4704266-cf70-11ee-95bb-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.99', '--skip-admin-label'] 2024-02-19T21:50:01.877 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: 4.9.3-dev 2024-02-19T21:50:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:Verifying podman|docker is present... 2024-02-19T21:50:01.904 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: 4.9.3-dev 2024-02-19T21:50:01.911 INFO:teuthology.orchestra.run.smithi099.stderr:Verifying lvm2 is present... 2024-02-19T21:50:01.911 INFO:teuthology.orchestra.run.smithi099.stderr:Verifying time synchronization is in place... 2024-02-19T21:50:01.918 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-02-19T21:50:01.924 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: inactive 2024-02-19T21:50:01.930 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: enabled 2024-02-19T21:50:01.935 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: active 2024-02-19T21:50:01.936 INFO:teuthology.orchestra.run.smithi099.stderr:Unit chronyd.service is enabled and running 2024-02-19T21:50:01.936 INFO:teuthology.orchestra.run.smithi099.stderr:Repeating the final host check... 2024-02-19T21:50:01.955 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: 4.9.3-dev 2024-02-19T21:50:01.966 INFO:teuthology.orchestra.run.smithi099.stderr:podman (/bin/podman) version 4.9.3 is present 2024-02-19T21:50:01.966 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl is present 2024-02-19T21:50:01.966 INFO:teuthology.orchestra.run.smithi099.stderr:lvcreate is present 2024-02-19T21:50:01.971 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-02-19T21:50:01.976 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: inactive 2024-02-19T21:50:01.982 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: enabled 2024-02-19T21:50:01.988 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: active 2024-02-19T21:50:01.988 INFO:teuthology.orchestra.run.smithi099.stderr:Unit chronyd.service is enabled and running 2024-02-19T21:50:01.989 INFO:teuthology.orchestra.run.smithi099.stderr:Host looks OK 2024-02-19T21:50:01.989 INFO:teuthology.orchestra.run.smithi099.stderr:Cluster fsid: d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:50:01.989 INFO:teuthology.orchestra.run.smithi099.stderr:Acquiring lock 139653172058600 on /run/cephadm/d4704266-cf70-11ee-95bb-87774f69a715.lock 2024-02-19T21:50:01.989 INFO:teuthology.orchestra.run.smithi099.stderr:Lock 139653172058600 acquired on /run/cephadm/d4704266-cf70-11ee-95bb-87774f69a715.lock 2024-02-19T21:50:01.989 INFO:teuthology.orchestra.run.smithi099.stderr:Verifying IP 172.21.15.99 port 3300 ... 2024-02-19T21:50:01.989 INFO:teuthology.orchestra.run.smithi099.stderr:Verifying IP 172.21.15.99 port 6789 ... 2024-02-19T21:50:01.990 INFO:teuthology.orchestra.run.smithi099.stderr:Base mon IP(s) is [172.21.15.99:3300, 172.21.15.99:6789], mon addrv is [v2:172.21.15.99:3300,v1:172.21.15.99:6789] 2024-02-19T21:50:01.992 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.99 metric 100 2024-02-19T21:50:01.992 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.99 metric 100 2024-02-19T21:50:01.995 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-02-19T21:50:01.995 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-02-19T21:50:01.995 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1794sec hoplimit 64 pref medium 2024-02-19T21:50:01.998 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-19T21:50:01.998 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-02-19T21:50:01.998 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-02-19T21:50:01.998 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-02-19T21:50:01.998 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2024-02-19T21:50:01.998 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-02-19T21:50:01.999 INFO:teuthology.orchestra.run.smithi099.stderr:Mon IP `172.21.15.99` is in CIDR network `172.21.0.0/20` 2024-02-19T21:50:01.999 INFO:teuthology.orchestra.run.smithi099.stderr:Mon IP `172.21.15.99` is in CIDR network `172.21.0.0/20` 2024-02-19T21:50:01.999 INFO:teuthology.orchestra.run.smithi099.stderr:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-19T21:50:01.999 INFO:teuthology.orchestra.run.smithi099.stderr:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-19T21:50:02.000 INFO:teuthology.orchestra.run.smithi099.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1... 2024-02-19T21:50:02.093 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1... 2024-02-19T21:50:02.331 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Getting image source signatures 2024-02-19T21:50:02.334 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Copying blob sha256:ec93555fb25f6296fcd66f232359fb768587e082c45b15dd379853eb0f28a963 2024-02-19T21:50:02.334 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Copying blob sha256:0f642e61a11afb42c0ccb5b05f5809250ad643ed143780d6ff49a5a4c492fc38 2024-02-19T21:50:27.715 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Copying config sha256:823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa 2024-02-19T21:50:27.849 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Writing manifest to image destination 2024-02-19T21:50:28.107 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: 823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa 2024-02-19T21:50:31.267 INFO:teuthology.orchestra.run.smithi099.stderr:ceph: ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable) 2024-02-19T21:50:32.402 INFO:teuthology.orchestra.run.smithi099.stderr:Ceph version: ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable) 2024-02-19T21:50:32.402 INFO:teuthology.orchestra.run.smithi099.stderr:Extracting ceph user uid/gid from container image... 2024-02-19T21:50:32.921 INFO:teuthology.orchestra.run.smithi099.stderr:stat: 167 167 2024-02-19T21:50:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:Creating initial keys... 2024-02-19T21:50:33.893 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-authtool: AQApzdNlUXjXLxAAXDnGqpXFKXQsVBs/94fUpA== 2024-02-19T21:50:35.050 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-authtool: AQAqzdNl8nwVOBAAOatBUhPz6uVvu4WGSgJmMA== 2024-02-19T21:50:36.129 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-authtool: AQAszdNlKTEEAhAA5RAlSFUCdv3dcnDOt4i79A== 2024-02-19T21:50:36.616 INFO:teuthology.orchestra.run.smithi099.stderr:Creating initial monmap... 2024-02-19T21:50:37.185 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-19T21:50:37.185 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:50:37.185 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-19T21:50:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:monmaptool for smithi099 [v2:172.21.15.99:3300,v1:172.21.15.99:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-19T21:50:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/monmaptool: set fsid to d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:50:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-19T21:50:37.691 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-19T21:50:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:Creating mon... 2024-02-19T21:50:38.270 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.152+0000 7f45c54de880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-19T21:50:38.270 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.153+0000 7f45c54de880 1 imported monmap: 2024-02-19T21:50:38.270 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: epoch 0 2024-02-19T21:50:38.270 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: fsid d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:50:38.270 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: last_changed 2024-02-19T21:50:37.062089+0000 2024-02-19T21:50:38.270 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: created 2024-02-19T21:50:37.062089+0000 2024-02-19T21:50:38.270 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2024-02-19T21:50:38.270 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: election_strategy: 1 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.smithi099 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.153+0000 7f45c54de880 0 /usr/bin/ceph-mon: set fsid to d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: RocksDB version: 6.8.1 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Compile date Feb 17 2024 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: DB SUMMARY 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi099/store.db dir, Total Num: 0, files: 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi099/store.db: 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.error_if_exists: 0 2024-02-19T21:50:38.271 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.create_if_missing: 1 2024-02-19T21:50:38.272 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.paranoid_checks: 1 2024-02-19T21:50:38.272 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.env: 0x5590e207d080 2024-02-19T21:50:38.272 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.fs: Posix File System 2024-02-19T21:50:38.272 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.info_log: 0x5590e2e21300 2024-02-19T21:50:38.272 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-19T21:50:38.272 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.statistics: (nil) 2024-02-19T21:50:38.272 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.use_fsync: 0 2024-02-19T21:50:38.272 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_log_file_size: 0 2024-02-19T21:50:38.272 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-19T21:50:38.272 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-19T21:50:38.272 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-19T21:50:38.272 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-19T21:50:38.272 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.allow_fallocate: 1 2024-02-19T21:50:38.273 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-19T21:50:38.273 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-19T21:50:38.273 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.use_direct_reads: 0 2024-02-19T21:50:38.273 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-19T21:50:38.273 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-19T21:50:38.273 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.db_log_dir: 2024-02-19T21:50:38.273 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi099/store.db 2024-02-19T21:50:38.273 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-19T21:50:38.273 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_subcompactions: 1 2024-02-19T21:50:38.273 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_background_flushes: -1 2024-02-19T21:50:38.273 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-19T21:50:38.273 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-19T21:50:38.273 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-19T21:50:38.273 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-19T21:50:38.274 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-19T21:50:38.274 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-19T21:50:38.274 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-19T21:50:38.274 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.write_buffer_manager: 0x5590e2e27950 2024-02-19T21:50:38.274 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-19T21:50:38.274 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-19T21:50:38.274 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-19T21:50:38.274 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-19T21:50:38.274 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-19T21:50:38.274 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-19T21:50:38.274 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-19T21:50:38.274 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-19T21:50:38.274 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-19T21:50:38.275 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.unordered_write: 0 2024-02-19T21:50:38.275 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-19T21:50:38.275 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-19T21:50:38.275 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-19T21:50:38.275 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-19T21:50:38.275 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.row_cache: None 2024-02-19T21:50:38.275 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.wal_filter: None 2024-02-19T21:50:38.275 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-19T21:50:38.275 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-19T21:50:38.275 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.preserve_deletes: 0 2024-02-19T21:50:38.275 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.two_write_queues: 0 2024-02-19T21:50:38.275 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-19T21:50:38.275 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.atomic_flush: 0 2024-02-19T21:50:38.275 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-19T21:50:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-19T21:50:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-19T21:50:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.log_readahead_size: 0 2024-02-19T21:50:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-19T21:50:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_background_jobs: 2 2024-02-19T21:50:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_background_compactions: -1 2024-02-19T21:50:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-19T21:50:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-19T21:50:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-19T21:50:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-19T21:50:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-19T21:50:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-19T21:50:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-19T21:50:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_open_files: -1 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Compression algorithms supported: 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: kZSTD supported: 0 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: kXpressCompression supported: 0 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: kLZ4Compression supported: 1 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: kBZip2Compression supported: 0 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: kZlibCompression supported: 1 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: kSnappyCompression supported: 1 2024-02-19T21:50:38.277 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi099/store.db/MANIFEST-000001 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.merge_operator: 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compaction_filter: None 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5590e2d37d18) 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2024-02-19T21:50:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: index_type: 0 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: index_shortening: 1 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: checksum: 1 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: block_cache: 0x5590e2d6cd10 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: block_cache_options: 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: capacity : 536870912 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2024-02-19T21:50:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2024-02-19T21:50:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2024-02-19T21:50:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2024-02-19T21:50:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2024-02-19T21:50:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: block_size: 4096 2024-02-19T21:50:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2024-02-19T21:50:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2024-02-19T21:50:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2024-02-19T21:50:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2024-02-19T21:50:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: partition_filters: 0 2024-02-19T21:50:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2024-02-19T21:50:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-19T21:50:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2024-02-19T21:50:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: verify_compression: 0 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: format_version: 2 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: block_align: 0 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compression: NoCompression 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.num_levels: 7 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-19T21:50:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-19T21:50:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-19T21:50:38.283 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-19T21:50:38.284 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-19T21:50:38.284 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-19T21:50:38.284 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-19T21:50:38.284 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-19T21:50:38.284 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-19T21:50:38.284 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-19T21:50:38.284 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-19T21:50:38.284 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-19T21:50:38.284 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-19T21:50:38.284 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-19T21:50:38.284 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-19T21:50:38.284 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-19T21:50:38.284 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-19T21:50:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-19T21:50:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.table_properties_collectors: 2024-02-19T21:50:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.inplace_update_support: 0 2024-02-19T21:50:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-19T21:50:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-19T21:50:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-19T21:50:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-19T21:50:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.bloom_locality: 0 2024-02-19T21:50:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.max_successive_merges: 0 2024-02-19T21:50:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-19T21:50:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-19T21:50:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-19T21:50:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-19T21:50:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.ttl: 2592000 2024-02-19T21:50:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.154+0000 7f45c54de880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-19T21:50:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.155+0000 7f45c54de880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi099/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-19T21:50:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.155+0000 7f45c54de880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-19T21:50:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.156+0000 7f45c54de880 4 rocksdb: DB pointer 0x5590e2e35800 2024-02-19T21:50:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.156+0000 7f45ae351700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-19T21:50:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.156+0000 7f45ae351700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-19T21:50:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2024-02-19T21:50:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:50:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-19T21:50:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T21:50:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T21:50:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-19T21:50:38.287 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-19T21:50:38.287 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T21:50:38.287 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.287 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-19T21:50:38.287 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:50:38.287 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:50:38.287 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-19T21:50:38.287 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-19T21:50:38.287 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.287 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-19T21:50:38.287 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:50:38.287 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:50:38.287 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:50:38.287 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T21:50:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T21:50:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T21:50:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T21:50:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-02-19T21:50:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:50:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:50:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T21:50:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-02-19T21:50:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-19T21:50:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:50:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:50:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T21:50:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-02-19T21:50:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: 2024-02-19T21:50:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.157+0000 7f45c54de880 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2024-02-19T21:50:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.157+0000 7f45c54de880 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2024-02-19T21:50:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-mon: debug 2024-02-19T21:50:38.157+0000 7f45c54de880 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi099 for mon.smithi099 2024-02-19T21:50:38.768 INFO:teuthology.orchestra.run.smithi099.stderr:create mon.smithi099 on 2024-02-19T21:50:38.783 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-02-19T21:50:38.875 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-19T21:50:38.967 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d4704266-cf70-11ee-95bb-87774f69a715.target → /etc/systemd/system/ceph-d4704266-cf70-11ee-95bb-87774f69a715.target. 2024-02-19T21:50:38.967 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-d4704266-cf70-11ee-95bb-87774f69a715.target → /etc/systemd/system/ceph-d4704266-cf70-11ee-95bb-87774f69a715.target. 2024-02-19T21:50:39.170 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Failed to reset failed state of unit ceph-d4704266-cf70-11ee-95bb-87774f69a715@mon.smithi099.service: Unit ceph-d4704266-cf70-11ee-95bb-87774f69a715@mon.smithi099.service not loaded. 2024-02-19T21:50:39.177 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Created symlink /etc/systemd/system/ceph-d4704266-cf70-11ee-95bb-87774f69a715.target.wants/ceph-d4704266-cf70-11ee-95bb-87774f69a715@mon.smithi099.service → /etc/systemd/system/ceph-d4704266-cf70-11ee-95bb-87774f69a715@.service. 2024-02-19T21:50:39.905 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: disabled 2024-02-19T21:50:39.912 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: inactive 2024-02-19T21:50:39.912 INFO:teuthology.orchestra.run.smithi099.stderr:firewalld.service is not enabled 2024-02-19T21:50:39.913 INFO:teuthology.orchestra.run.smithi099.stderr:Not possible to enable service . firewalld.service is not available 2024-02-19T21:50:39.913 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for mon to start... 2024-02-19T21:50:39.913 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for mon... 2024-02-19T21:50:40.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:39 smithi099 bash[36898]: 81f207afc3b2c8cbeadfbaf4c52972239c770cc860f796ecd02cf43d6c3c6f8a 2024-02-19T21:50:40.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:39 smithi099 systemd[1]: Started Ceph mon.smithi099 for d4704266-cf70-11ee-95bb-87774f69a715. 2024-02-19T21:50:40.500 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: cluster: 2024-02-19T21:50:40.500 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: id: d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:50:40.500 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-02-19T21:50:40.500 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-02-19T21:50:40.500 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: services: 2024-02-19T21:50:40.500 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon: 1 daemons, quorum smithi099 (age 0.645039s) 2024-02-19T21:50:40.500 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mgr: no daemons active 2024-02-19T21:50:40.500 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-02-19T21:50:40.501 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-02-19T21:50:40.501 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: data: 2024-02-19T21:50:40.501 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-02-19T21:50:40.501 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-02-19T21:50:40.501 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-02-19T21:50:40.501 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: pgs: 2024-02-19T21:50:40.501 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-02-19T21:50:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:mon is available 2024-02-19T21:50:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:Assimilating anything we can from ceph.conf... 2024-02-19T21:50:41.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[36913]: cluster 2024-02-19T21:50:39.854555+0000 mon.smithi099 (mon.0) 2 : cluster [INF] mon.smithi099 is new leader, mons smithi099 in quorum (ranks 0) 2024-02-19T21:50:41.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[36913]: cluster 2024-02-19T21:50:39.854767+0000 mon.smithi099 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi099=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0]} removed_ranks: {} 2024-02-19T21:50:41.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[36913]: cluster 2024-02-19T21:50:39.859686+0000 mon.smithi099 (mon.0) 4 : cluster [DBG] fsmap 2024-02-19T21:50:41.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[36913]: cluster 2024-02-19T21:50:39.862795+0000 mon.smithi099 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-19T21:50:41.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[36913]: cluster 2024-02-19T21:50:39.863322+0000 mon.smithi099 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-02-19T21:50:41.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[36913]: audit 2024-02-19T21:50:40.499553+0000 mon.smithi099 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.99:0/3282808115' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-19T21:50:41.601 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-02-19T21:50:41.601 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: [global] 2024-02-19T21:50:41.602 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: fsid = d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:50:41.602 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: log_to_journald = false 2024-02-19T21:50:41.602 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.99:3300,v1:172.21.15.99:6789] 2024-02-19T21:50:41.602 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-02-19T21:50:41.602 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-02-19T21:50:41.602 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-02-19T21:50:41.602 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-02-19T21:50:41.602 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-02-19T21:50:41.602 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: [mgr] 2024-02-19T21:50:41.602 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-02-19T21:50:41.602 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-02-19T21:50:41.602 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: [osd] 2024-02-19T21:50:41.602 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-02-19T21:50:41.602 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-02-19T21:50:41.880 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[36913]: audit 2024-02-19T21:50:41.597652+0000 mon.smithi099 (mon.0) 8 : audit [INF] from='client.? 172.21.15.99:0/1452746278' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-19T21:50:41.880 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[36913]: audit 2024-02-19T21:50:41.600354+0000 mon.smithi099 (mon.0) 9 : audit [INF] from='client.? 172.21.15.99:0/1452746278' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-19T21:50:42.075 INFO:teuthology.orchestra.run.smithi099.stderr:Generating new minimal ceph.conf... 2024-02-19T21:50:42.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[36913]: audit 2024-02-19T21:50:42.624454+0000 mon.smithi099 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.99:0/3197890263' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:50:43.249 INFO:teuthology.orchestra.run.smithi099.stderr:Restarting the monitor... 2024-02-19T21:50:43.505 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:43 smithi099 systemd[1]: Stopping Ceph mon.smithi099 for d4704266-cf70-11ee-95bb-87774f69a715... 2024-02-19T21:50:43.505 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:43 smithi099 bash[37240]: Error: no container with name or ID "ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon.smithi099" found: no such container 2024-02-19T21:50:43.758 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[36913]: debug 2024-02-19T21:50:43.505+0000 7f6b9fc1c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi099 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-19T21:50:43.758 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[36913]: debug 2024-02-19T21:50:43.505+0000 7f6b9fc1c700 -1 mon.smithi099@0(leader) e1 *** Got Signal Terminated *** 2024-02-19T21:50:44.084 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:43 smithi099 bash[37279]: ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099 2024-02-19T21:50:44.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 systemd[1]: ceph-d4704266-cf70-11ee-95bb-87774f69a715@mon.smithi099.service: Succeeded. 2024-02-19T21:50:44.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 systemd[1]: Stopped Ceph mon.smithi099 for d4704266-cf70-11ee-95bb-87774f69a715. 2024-02-19T21:50:44.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 systemd[1]: Starting Ceph mon.smithi099 for d4704266-cf70-11ee-95bb-87774f69a715... 2024-02-19T21:50:44.748 INFO:teuthology.orchestra.run.smithi099.stderr:Setting public_network to 172.21.0.0/20 in mon config section 2024-02-19T21:50:44.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.705+0000 7f81ae000880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-19T21:50:44.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.705+0000 7f81ae000880 0 ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable), process ceph-mon, pid 7 2024-02-19T21:50:44.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.705+0000 7f81ae000880 0 pidfile_write: ignore empty --pid-file 2024-02-19T21:50:44.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.710+0000 7f81ae000880 0 load: jerasure load: lrc load: isa 2024-02-19T21:50:44.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: RocksDB version: 6.8.1 2024-02-19T21:50:44.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Compile date Feb 17 2024 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: DB SUMMARY 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: CURRENT file: CURRENT 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi099/store.db dir, Total Num: 1, files: 000004.sst 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi099/store.db: 000006.log size: 87011 ; 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.error_if_exists: 0 2024-02-19T21:50:44.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.create_if_missing: 0 2024-02-19T21:50:44.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.paranoid_checks: 1 2024-02-19T21:50:44.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.env: 0x55ffb18bf080 2024-02-19T21:50:44.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.fs: Posix File System 2024-02-19T21:50:44.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.info_log: 0x55ffb3c42560 2024-02-19T21:50:44.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-19T21:50:44.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.statistics: (nil) 2024-02-19T21:50:44.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.use_fsync: 0 2024-02-19T21:50:44.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_log_file_size: 0 2024-02-19T21:50:44.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-19T21:50:44.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-19T21:50:44.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-19T21:50:44.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-19T21:50:44.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.allow_fallocate: 1 2024-02-19T21:50:44.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-19T21:50:44.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-19T21:50:44.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.use_direct_reads: 0 2024-02-19T21:50:44.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-19T21:50:44.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-19T21:50:44.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.db_log_dir: 2024-02-19T21:50:44.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi099/store.db 2024-02-19T21:50:44.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-19T21:50:44.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_subcompactions: 1 2024-02-19T21:50:44.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_background_flushes: -1 2024-02-19T21:50:44.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-19T21:50:44.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-19T21:50:44.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-19T21:50:44.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-19T21:50:44.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-19T21:50:44.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-19T21:50:44.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-19T21:50:44.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.write_buffer_manager: 0x55ffb48b2450 2024-02-19T21:50:44.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-19T21:50:44.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-19T21:50:44.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-19T21:50:44.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-19T21:50:44.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-19T21:50:44.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-19T21:50:44.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-19T21:50:44.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-19T21:50:44.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.unordered_write: 0 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.row_cache: None 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.wal_filter: None 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.preserve_deletes: 0 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.two_write_queues: 0 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.atomic_flush: 0 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-19T21:50:44.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-19T21:50:44.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-19T21:50:44.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.log_readahead_size: 0 2024-02-19T21:50:44.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-19T21:50:44.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_background_jobs: 2 2024-02-19T21:50:44.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_background_compactions: -1 2024-02-19T21:50:44.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-19T21:50:44.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-19T21:50:44.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-19T21:50:44.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-19T21:50:44.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-19T21:50:44.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-19T21:50:44.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-19T21:50:44.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_open_files: -1 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Compression algorithms supported: 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: kZSTD supported: 0 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: kXpressCompression supported: 0 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: kLZ4Compression supported: 1 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: kBZip2Compression supported: 0 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: kZlibCompression supported: 1 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: kSnappyCompression supported: 1 2024-02-19T21:50:44.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-19T21:50:44.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi099/store.db/MANIFEST-000005 2024-02-19T21:50:44.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-19T21:50:44.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-19T21:50:44.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.merge_operator: 2024-02-19T21:50:44.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compaction_filter: None 2024-02-19T21:50:44.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-19T21:50:44.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-19T21:50:44.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-19T21:50:44.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ffb3be7d10) 2024-02-19T21:50:44.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cache_index_and_filter_blocks: 1 2024-02-19T21:50:44.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-19T21:50:44.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-19T21:50:44.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: pin_top_level_index_and_filter: 1 2024-02-19T21:50:44.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: index_type: 0 2024-02-19T21:50:44.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: data_block_index_type: 0 2024-02-19T21:50:44.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: index_shortening: 1 2024-02-19T21:50:44.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: data_block_hash_table_util_ratio: 0.750000 2024-02-19T21:50:44.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: hash_index_allow_collision: 1 2024-02-19T21:50:44.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: checksum: 1 2024-02-19T21:50:44.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: no_block_cache: 0 2024-02-19T21:50:44.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: block_cache: 0x55ffb3c1cf10 2024-02-19T21:50:44.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: block_cache_name: BinnedLRUCache 2024-02-19T21:50:44.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: block_cache_options: 2024-02-19T21:50:44.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: capacity : 536870912 2024-02-19T21:50:44.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: num_shard_bits : 4 2024-02-19T21:50:44.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: strict_capacity_limit : 0 2024-02-19T21:50:44.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: high_pri_pool_ratio: 0.000 2024-02-19T21:50:44.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: block_cache_compressed: (nil) 2024-02-19T21:50:44.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: persistent_cache: (nil) 2024-02-19T21:50:44.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: block_size: 4096 2024-02-19T21:50:44.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: block_size_deviation: 10 2024-02-19T21:50:44.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: block_restart_interval: 16 2024-02-19T21:50:44.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: index_block_restart_interval: 1 2024-02-19T21:50:44.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: metadata_block_size: 4096 2024-02-19T21:50:44.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: partition_filters: 0 2024-02-19T21:50:44.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: use_delta_encoding: 1 2024-02-19T21:50:44.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-19T21:50:44.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: whole_key_filtering: 1 2024-02-19T21:50:44.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: verify_compression: 0 2024-02-19T21:50:44.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: read_amp_bytes_per_bit: 0 2024-02-19T21:50:44.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: format_version: 2 2024-02-19T21:50:44.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: enable_index_compression: 1 2024-02-19T21:50:44.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: block_align: 0 2024-02-19T21:50:44.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-19T21:50:44.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-19T21:50:44.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compression: NoCompression 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.num_levels: 7 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-19T21:50:44.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-19T21:50:44.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-19T21:50:44.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-19T21:50:44.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-19T21:50:44.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-19T21:50:44.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-19T21:50:44.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-19T21:50:44.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-19T21:50:44.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-19T21:50:44.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-19T21:50:44.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-19T21:50:44.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-19T21:50:44.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-19T21:50:44.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-19T21:50:44.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-19T21:50:44.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-19T21:50:44.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-19T21:50:44.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-19T21:50:44.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-19T21:50:44.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-19T21:50:44.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-19T21:50:44.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-19T21:50:44.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-19T21:50:44.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-19T21:50:44.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-19T21:50:44.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-19T21:50:44.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-19T21:50:44.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-19T21:50:44.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-19T21:50:44.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-19T21:50:44.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-19T21:50:44.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-19T21:50:44.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-19T21:50:44.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-19T21:50:44.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-19T21:50:44.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-19T21:50:44.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-19T21:50:44.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.table_properties_collectors: 2024-02-19T21:50:44.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.inplace_update_support: 0 2024-02-19T21:50:44.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-19T21:50:44.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-19T21:50:44.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-19T21:50:44.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-19T21:50:44.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.bloom_locality: 0 2024-02-19T21:50:44.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.max_successive_merges: 0 2024-02-19T21:50:44.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-19T21:50:44.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-19T21:50:44.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-19T21:50:44.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-19T21:50:44.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.ttl: 2592000 2024-02-19T21:50:44.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.711+0000 7f81ae000880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-19T21:50:44.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.712+0000 7f81ae000880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi099/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-19T21:50:44.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.712+0000 7f81ae000880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2024-02-19T21:50:44.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.712+0000 7f81ae000880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708379444712486, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-02-19T21:50:44.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.712+0000 7f81ae000880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.712+0000 7f81ae000880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.713+0000 7f81ae000880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708379444713645, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 83720, "table_properties": {"data_size": 81987, "index_size": 338, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 9462, "raw_average_key_size": 47, "raw_value_size": 76542, "raw_average_value_size": 382, "num_data_blocks": 11, "num_entries": 200, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708379444, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.713+0000 7f81ae000880 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.713+0000 7f81ae000880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708379444714149, "job": 1, "event": "recovery_finished"} 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.714+0000 7f81ae000880 4 rocksdb: DB pointer 0x55ffb3ce5800 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.715+0000 7f8194df2700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.715+0000 7f8194df2700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: ** DB Stats ** 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-19T21:50:44.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: ** Compaction Stats [default] ** 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: L0 2/0 83.45 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 103.8 0.00 0.00 1 0.001 0 0 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Sum 2/0 83.45 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 103.8 0.00 0.00 1 0.001 0 0 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 103.8 0.00 0.00 1 0.001 0 0 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: ** Compaction Stats [default] ** 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 103.8 0.00 0.00 1 0.001 0 0 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:50:44.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T21:50:44.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T21:50:44.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T21:50:44.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T21:50:44.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: AddFile(Keys): cumulative 0, interval 0 2024-02-19T21:50:44.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Cumulative compaction: 0.00 GB write, 22.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:50:44.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Interval compaction: 0.00 GB write, 22.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:50:44.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T21:50:44.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: ** File Read Latency Histogram By Level [default] ** 2024-02-19T21:50:44.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: ** Compaction Stats [default] ** 2024-02-19T21:50:44.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:50:44.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:50:44.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: L0 2/0 83.45 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 103.8 0.00 0.00 1 0.001 0 0 2024-02-19T21:50:44.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Sum 2/0 83.45 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 103.8 0.00 0.00 1 0.001 0 0 2024-02-19T21:50:44.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-19T21:50:44.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: ** Compaction Stats [default] ** 2024-02-19T21:50:44.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:50:44.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:50:44.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 103.8 0.00 0.00 1 0.001 0 0 2024-02-19T21:50:44.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:50:44.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T21:50:44.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T21:50:44.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T21:50:44.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T21:50:44.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: AddFile(Keys): cumulative 0, interval 0 2024-02-19T21:50:44.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Cumulative compaction: 0.00 GB write, 22.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:50:44.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:50:44.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T21:50:44.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: ** File Read Latency Histogram By Level [default] ** 2024-02-19T21:50:44.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.715+0000 7f81ae000880 0 starting mon.smithi099 rank 0 at public addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] at bind addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi099 fsid d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:50:44.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.717+0000 7f81ae000880 1 mon.smithi099@-1(???) e1 preinit fsid d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:50:44.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.717+0000 7f81ae000880 0 mon.smithi099@-1(???).mds e1 new map 2024-02-19T21:50:44.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.717+0000 7f81ae000880 0 mon.smithi099@-1(???).mds e1 print_map 2024-02-19T21:50:44.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: e1 2024-02-19T21:50:44.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T21:50:44.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T21:50:44.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: legacy client fscid: -1 2024-02-19T21:50:44.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: No filesystems configured 2024-02-19T21:50:44.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: 2024-02-19T21:50:44.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.717+0000 7f81ae000880 0 mon.smithi099@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-19T21:50:44.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.717+0000 7f81ae000880 0 mon.smithi099@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:50:44.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.717+0000 7f81ae000880 0 mon.smithi099@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:50:44.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.717+0000 7f81ae000880 0 mon.smithi099@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:50:44.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:42.624454+0000 mon.smithi099 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.99:0/3197890263' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:50:44.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:50:44.717+0000 7f81ae000880 1 mon.smithi099@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-19T21:50:44.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 bash[37402]: 6d9ffe0655abf9b1025ecb8ff82023f624c67a5e01bd0268aa399b56054e9b82 2024-02-19T21:50:44.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 systemd[1]: Started Ceph mon.smithi099 for d4704266-cf70-11ee-95bb-87774f69a715. 2024-02-19T21:50:44.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:50:44.733852+0000 mon.smithi099 (mon.0) 1 : cluster [INF] mon.smithi099 is new leader, mons smithi099 in quorum (ranks 0) 2024-02-19T21:50:44.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:50:44.733906+0000 mon.smithi099 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi099=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0]} removed_ranks: {} 2024-02-19T21:50:44.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:50:44.734309+0000 mon.smithi099 (mon.0) 3 : cluster [DBG] fsmap 2024-02-19T21:50:44.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:50:44.734337+0000 mon.smithi099 (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-19T21:50:44.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:50:44.734683+0000 mon.smithi099 (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-02-19T21:50:45.845 INFO:teuthology.orchestra.run.smithi099.stderr:Wrote config to /etc/ceph/ceph.conf 2024-02-19T21:50:45.845 INFO:teuthology.orchestra.run.smithi099.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-19T21:50:45.845 INFO:teuthology.orchestra.run.smithi099.stderr:Creating mgr... 2024-02-19T21:50:45.846 INFO:teuthology.orchestra.run.smithi099.stderr:Verifying port 9283 ... 2024-02-19T21:50:45.976 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Failed to reset failed state of unit ceph-d4704266-cf70-11ee-95bb-87774f69a715@mgr.smithi099.zfglya.service: Unit ceph-d4704266-cf70-11ee-95bb-87774f69a715@mgr.smithi099.zfglya.service not loaded. 2024-02-19T21:50:45.982 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Created symlink /etc/systemd/system/ceph-d4704266-cf70-11ee-95bb-87774f69a715.target.wants/ceph-d4704266-cf70-11ee-95bb-87774f69a715@mgr.smithi099.zfglya.service → /etc/systemd/system/ceph-d4704266-cf70-11ee-95bb-87774f69a715@.service. 2024-02-19T21:50:46.654 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:45.312842+0000 mon.smithi099 (mon.0) 6 : audit [INF] from='client.? 172.21.15.99:0/650903506' entity='client.admin' 2024-02-19T21:50:46.668 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: disabled 2024-02-19T21:50:46.675 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: inactive 2024-02-19T21:50:46.676 INFO:teuthology.orchestra.run.smithi099.stderr:firewalld.service is not enabled 2024-02-19T21:50:46.676 INFO:teuthology.orchestra.run.smithi099.stderr:Not possible to enable service . firewalld.service is not available 2024-02-19T21:50:46.683 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: disabled 2024-02-19T21:50:46.691 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: inactive 2024-02-19T21:50:46.692 INFO:teuthology.orchestra.run.smithi099.stderr:firewalld.service is not enabled 2024-02-19T21:50:46.692 INFO:teuthology.orchestra.run.smithi099.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-02-19T21:50:46.692 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for mgr to start... 2024-02-19T21:50:46.692 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for mgr... 2024-02-19T21:50:47.362 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-02-19T21:50:47.362 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: { 2024-02-19T21:50:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "fsid": "d4704266-cf70-11ee-95bb-87774f69a715", 2024-02-19T21:50:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "health": { 2024-02-19T21:50:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-19T21:50:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "checks": {}, 2024-02-19T21:50:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mutes": [] 2024-02-19T21:50:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-19T21:50:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum": [ 2024-02-19T21:50:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 0 2024-02-19T21:50:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-02-19T21:50:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-19T21:50:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "smithi099" 2024-02-19T21:50:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-02-19T21:50:47.363 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum_age": 2, 2024-02-19T21:50:47.364 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "monmap": { 2024-02-19T21:50:47.364 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:50:47.364 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-19T21:50:47.364 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-19T21:50:47.364 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:47.364 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osdmap": { 2024-02-19T21:50:47.364 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:50:47.364 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-19T21:50:47.364 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-19T21:50:47.364 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-19T21:50:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-19T21:50:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-19T21:50:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-19T21:50:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "pgmap": { 2024-02-19T21:50:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-19T21:50:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-19T21:50:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "fsmap": { 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "available": false, 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-19T21:50:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "modules": [ 2024-02-19T21:50:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "iostat", 2024-02-19T21:50:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "nfs", 2024-02-19T21:50:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "restful" 2024-02-19T21:50:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-02-19T21:50:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "services": {} 2024-02-19T21:50:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "servicemap": { 2024-02-19T21:50:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:50:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "modified": "2024-02-19T21:50:39.858034+0000", 2024-02-19T21:50:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "services": {} 2024-02-19T21:50:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-19T21:50:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: } 2024-02-19T21:50:47.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:47.360667+0000 mon.smithi099 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.99:0/3635270588' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-19T21:50:47.947 INFO:teuthology.orchestra.run.smithi099.stderr:mgr not available, waiting (1/15)... 2024-02-19T21:50:50.554 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-02-19T21:50:50.554 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: { 2024-02-19T21:50:50.554 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "fsid": "d4704266-cf70-11ee-95bb-87774f69a715", 2024-02-19T21:50:50.554 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "health": { 2024-02-19T21:50:50.554 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-19T21:50:50.554 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "checks": {}, 2024-02-19T21:50:50.554 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mutes": [] 2024-02-19T21:50:50.554 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:50.554 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-19T21:50:50.555 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum": [ 2024-02-19T21:50:50.555 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 0 2024-02-19T21:50:50.555 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-02-19T21:50:50.555 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-19T21:50:50.555 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "smithi099" 2024-02-19T21:50:50.555 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-02-19T21:50:50.555 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum_age": 5, 2024-02-19T21:50:50.555 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "monmap": { 2024-02-19T21:50:50.555 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:50:50.555 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-19T21:50:50.555 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-19T21:50:50.555 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:50.556 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osdmap": { 2024-02-19T21:50:50.556 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:50:50.556 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-19T21:50:50.556 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-19T21:50:50.556 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-19T21:50:50.556 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-19T21:50:50.556 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-19T21:50:50.556 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-19T21:50:50.556 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:50.556 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "pgmap": { 2024-02-19T21:50:50.556 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-19T21:50:50.556 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-19T21:50:50.557 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-19T21:50:50.557 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-19T21:50:50.557 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-19T21:50:50.557 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-19T21:50:50.557 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-19T21:50:50.557 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-19T21:50:50.557 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:50.557 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "fsmap": { 2024-02-19T21:50:50.557 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:50:50.557 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-19T21:50:50.557 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-19T21:50:50.557 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:50.557 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-19T21:50:50.558 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "available": false, 2024-02-19T21:50:50.558 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-19T21:50:50.558 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "modules": [ 2024-02-19T21:50:50.558 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "iostat", 2024-02-19T21:50:50.558 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "nfs", 2024-02-19T21:50:50.558 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "restful" 2024-02-19T21:50:50.558 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-02-19T21:50:50.558 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "services": {} 2024-02-19T21:50:50.558 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:50.558 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "servicemap": { 2024-02-19T21:50:50.558 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:50:50.558 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "modified": "2024-02-19T21:50:39.858034+0000", 2024-02-19T21:50:50.559 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "services": {} 2024-02-19T21:50:50.559 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:50.559 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-19T21:50:50.559 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: } 2024-02-19T21:50:50.848 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:50.548456+0000 mon.smithi099 (mon.0) 8 : audit [DBG] from='client.? 172.21.15.99:0/1378711696' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-19T21:50:51.279 INFO:teuthology.orchestra.run.smithi099.stderr:mgr not available, waiting (2/15)... 2024-02-19T21:50:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:50:51.893253+0000 mon.smithi099 (mon.0) 9 : cluster [INF] Activating manager daemon smithi099.zfglya 2024-02-19T21:50:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:50:51.895950+0000 mon.smithi099 (mon.0) 10 : cluster [DBG] mgrmap e2: smithi099.zfglya(active, starting, since 0.0027946s) 2024-02-19T21:50:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:51.896704+0000 mon.smithi099 (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.99:0/2797518897' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T21:50:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:51.896859+0000 mon.smithi099 (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.99:0/2797518897' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T21:50:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:51.896963+0000 mon.smithi099 (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.99:0/2797518897' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T21:50:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:51.897073+0000 mon.smithi099 (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.99:0/2797518897' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-02-19T21:50:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:51.897317+0000 mon.smithi099 (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.99:0/2797518897' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mgr metadata", "who": "smithi099.zfglya", "id": "smithi099.zfglya"}]: dispatch 2024-02-19T21:50:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:50:51.911819+0000 mon.smithi099 (mon.0) 16 : cluster [INF] Manager daemon smithi099.zfglya is now available 2024-02-19T21:50:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:51.920598+0000 mon.smithi099 (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.99:0/2797518897' entity='mgr.smithi099.zfglya' 2024-02-19T21:50:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:51.925653+0000 mon.smithi099 (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.99:0/2797518897' entity='mgr.smithi099.zfglya' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.zfglya/mirror_snapshot_schedule"}]: dispatch 2024-02-19T21:50:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:51.928128+0000 mon.smithi099 (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.99:0/2797518897' entity='mgr.smithi099.zfglya' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.zfglya/trash_purge_schedule"}]: dispatch 2024-02-19T21:50:52.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:51.930790+0000 mon.smithi099 (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.99:0/2797518897' entity='mgr.smithi099.zfglya' 2024-02-19T21:50:52.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:51.932802+0000 mon.smithi099 (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.99:0/2797518897' entity='mgr.smithi099.zfglya' 2024-02-19T21:50:53.995 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-02-19T21:50:53.995 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: { 2024-02-19T21:50:53.995 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "fsid": "d4704266-cf70-11ee-95bb-87774f69a715", 2024-02-19T21:50:53.996 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "health": { 2024-02-19T21:50:53.996 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-19T21:50:53.996 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "checks": {}, 2024-02-19T21:50:53.996 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mutes": [] 2024-02-19T21:50:53.996 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:53.996 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-19T21:50:53.996 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum": [ 2024-02-19T21:50:53.996 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 0 2024-02-19T21:50:53.996 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-02-19T21:50:53.996 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-19T21:50:53.996 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "smithi099" 2024-02-19T21:50:53.996 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-02-19T21:50:53.996 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum_age": 9, 2024-02-19T21:50:53.996 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "monmap": { 2024-02-19T21:50:53.997 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:50:53.997 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-19T21:50:53.997 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-19T21:50:53.997 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:53.997 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osdmap": { 2024-02-19T21:50:53.997 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:50:53.997 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-19T21:50:53.997 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-19T21:50:53.997 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-19T21:50:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-19T21:50:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-19T21:50:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-19T21:50:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "pgmap": { 2024-02-19T21:50:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-19T21:50:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-19T21:50:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-19T21:50:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-19T21:50:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-19T21:50:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-19T21:50:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-19T21:50:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-19T21:50:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "fsmap": { 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "available": true, 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "modules": [ 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "iostat", 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "nfs", 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "restful" 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "services": {} 2024-02-19T21:50:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "servicemap": { 2024-02-19T21:50:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-19T21:50:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "modified": "2024-02-19T21:50:39.858034+0000", 2024-02-19T21:50:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "services": {} 2024-02-19T21:50:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-02-19T21:50:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-19T21:50:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: } 2024-02-19T21:50:54.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:50:52.899096+0000 mon.smithi099 (mon.0) 22 : cluster [DBG] mgrmap e3: smithi099.zfglya(active, since 1.00594s) 2024-02-19T21:50:54.584 INFO:teuthology.orchestra.run.smithi099.stderr:mgr is available 2024-02-19T21:50:55.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:53.993961+0000 mon.smithi099 (mon.0) 23 : audit [DBG] from='client.? 172.21.15.99:0/504460694' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-19T21:50:55.297 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-02-19T21:50:55.297 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: [global] 2024-02-19T21:50:55.297 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: fsid = d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:50:55.297 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: log_to_journald = false 2024-02-19T21:50:55.297 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-02-19T21:50:55.297 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-02-19T21:50:55.297 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-02-19T21:50:55.298 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-02-19T21:50:55.298 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-02-19T21:50:55.298 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: [mgr] 2024-02-19T21:50:55.298 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-02-19T21:50:55.298 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-02-19T21:50:55.298 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: [osd] 2024-02-19T21:50:55.298 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-02-19T21:50:55.298 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-02-19T21:50:55.841 INFO:teuthology.orchestra.run.smithi099.stderr:Enabling cephadm module... 2024-02-19T21:50:56.103 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:50:54.899955+0000 mon.smithi099 (mon.0) 24 : cluster [DBG] mgrmap e4: smithi099.zfglya(active, since 3s) 2024-02-19T21:50:56.104 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:55.296226+0000 mon.smithi099 (mon.0) 25 : audit [INF] from='client.? 172.21.15.99:0/1141662723' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-19T21:50:57.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:56.603332+0000 mon.smithi099 (mon.0) 26 : audit [INF] from='client.? 172.21.15.99:0/3229300570' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-19T21:50:58.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:50:56.905761+0000 mon.smithi099 (mon.0) 27 : audit [INF] from='client.? 172.21.15.99:0/3229300570' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-19T21:50:58.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:50:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:50:56.905804+0000 mon.smithi099 (mon.0) 28 : cluster [DBG] mgrmap e5: smithi099.zfglya(active, since 5s) 2024-02-19T21:51:01.109 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:00.797593+0000 mon.smithi099 (mon.0) 29 : audit [DBG] from='client.? 172.21.15.99:0/3207416831' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-19T21:51:01.630 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: { 2024-02-19T21:51:01.630 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 5, 2024-02-19T21:51:01.630 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "available": true, 2024-02-19T21:51:01.630 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "active_name": "smithi099.zfglya", 2024-02-19T21:51:01.630 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_standby": 0 2024-02-19T21:51:01.631 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: } 2024-02-19T21:51:02.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:02.178278+0000 mon.smithi099 (mon.0) 30 : cluster [INF] Active manager daemon smithi099.zfglya restarted 2024-02-19T21:51:02.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:02.178698+0000 mon.smithi099 (mon.0) 31 : cluster [INF] Activating manager daemon smithi099.zfglya 2024-02-19T21:51:02.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:02.181546+0000 mon.smithi099 (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-02-19T21:51:02.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:02.181645+0000 mon.smithi099 (mon.0) 33 : cluster [DBG] mgrmap e6: smithi099.zfglya(active, starting, since 0.00305574s) 2024-02-19T21:51:02.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:02.182535+0000 mon.smithi099 (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-02-19T21:51:02.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:02.183176+0000 mon.smithi099 (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mgr metadata", "who": "smithi099.zfglya", "id": "smithi099.zfglya"}]: dispatch 2024-02-19T21:51:02.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:02.183781+0000 mon.smithi099 (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T21:51:02.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:02.184003+0000 mon.smithi099 (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T21:51:02.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:02.184222+0000 mon.smithi099 (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T21:51:02.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:02.197588+0000 mon.smithi099 (mon.0) 39 : cluster [INF] Manager daemon smithi099.zfglya is now available 2024-02-19T21:51:02.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:02.209688+0000 mon.smithi099 (mon.0) 40 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:03.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:51:02.206950+0000 mgr.smithi099.zfglya (mgr.14116) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-02-19T21:51:03.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:02.294775+0000 mon.smithi099 (mon.0) 41 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:03.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:02.295819+0000 mon.smithi099 (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:51:03.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:02.297335+0000 mon.smithi099 (mon.0) 43 : audit [DBG] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:51:03.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:02.299479+0000 mon.smithi099 (mon.0) 44 : audit [DBG] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:51:03.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:02.312906+0000 mon.smithi099 (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.zfglya/mirror_snapshot_schedule"}]: dispatch 2024-02-19T21:51:03.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:02.315675+0000 mon.smithi099 (mon.0) 46 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.zfglya/trash_purge_schedule"}]: dispatch 2024-02-19T21:51:03.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:03.183943+0000 mon.smithi099 (mon.0) 47 : cluster [DBG] mgrmap e7: smithi099.zfglya(active, since 1.00535s) 2024-02-19T21:51:05.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:04.297722+0000 mon.smithi099 (mon.0) 48 : cluster [DBG] mgrmap e8: smithi099.zfglya(active, since 2s) 2024-02-19T21:51:06.796 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for the mgr to restart... 2024-02-19T21:51:06.796 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for mgr epoch 5... 2024-02-19T21:51:07.343 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: { 2024-02-19T21:51:07.343 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mgrmap_epoch": 8, 2024-02-19T21:51:07.343 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "initialized": true 2024-02-19T21:51:07.343 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: } 2024-02-19T21:51:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:mgr epoch 5 is available 2024-02-19T21:51:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:Setting orchestrator backend to cephadm... 2024-02-19T21:51:08.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:07.337239+0000 mgr.smithi099.zfglya (mgr.14116) 2 : audit [DBG] from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-19T21:51:08.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:07.342997+0000 mgr.smithi099.zfglya (mgr.14116) 3 : audit [DBG] from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-19T21:51:09.945 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: value unchanged 2024-02-19T21:51:09.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:08.670341+0000 mgr.smithi099.zfglya (mgr.14116) 4 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:09.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:08.674316+0000 mon.smithi099 (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:09.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:08.684120+0000 mon.smithi099 (mon.0) 50 : audit [DBG] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:51:10.632 INFO:teuthology.orchestra.run.smithi099.stderr:Generating ssh key... 2024-02-19T21:51:11.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:09.945836+0000 mgr.smithi099.zfglya (mgr.14116) 5 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:12.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:11.325180+0000 mgr.smithi099.zfglya (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:12.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:51:11.325412+0000 mgr.smithi099.zfglya (mgr.14116) 7 : cephadm [INF] Generating ssh key... 2024-02-19T21:51:12.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:11.616214+0000 mon.smithi099 (mon.0) 51 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:12.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:11.617966+0000 mon.smithi099 (mon.0) 52 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:13.090 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqf12JMrvUXNG3MGdIz+EppcKnDIZKVOknZ+DjroKrDSwGFZ1Fjmq7lDvSIFahpsNaJsGoMzO4f7FPB9c4S6/SZr1FmzzzVyTeiTKpA73i5QlNTF4upk0SBTFnVlcMfhX9KzhpWPbbPhgzF2fBFowUf657EG9P+m75Wm9JlU/xu83ija6sP1qjI/IRt9U/PsZYsXFZODseGcxv7Yd14xTOwVVqBa+H8JLti9byscBtDHw+QAbFBXqy3kf3uPUoIaWHmH+Q4+CxH5qhKjuKgwhWnEpRu/suvFUSsFCmclliMhqm5iVF47afCifJFTgJta9mQrO8UIdJySOepcU8YvwzI66ngI+E9cc6T71+jbe2RB147/S1I9uvTJmPVPEjVTwgBzKVisZhjO9xGULKjGNLlvuDLuhnfjw6vFn5DtjTOzjDbE3MebWLachc4mjV/tiySPa/VRGYV5ng9+vkCGbwfklZxD2TVAEQ6LPnplD7cfL1umLfytRqEE1Z+OfyQj0= ceph-d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:51:13.620 INFO:teuthology.orchestra.run.smithi099.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-19T21:51:13.621 INFO:teuthology.orchestra.run.smithi099.stderr:Adding key to root@localhost authorized_keys... 2024-02-19T21:51:13.621 INFO:teuthology.orchestra.run.smithi099.stderr:Adding host smithi099... 2024-02-19T21:51:14.324 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:13.090972+0000 mgr.smithi099.zfglya (mgr.14116) 8 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:14.918 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: Added host 'smithi099' with addr '172.21.15.99' 2024-02-19T21:51:15.394 INFO:teuthology.orchestra.run.smithi099.stderr:Deploying mon service with default placement... 2024-02-19T21:51:16.162 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: Scheduled mon update... 2024-02-19T21:51:16.190 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:14.304266+0000 mgr.smithi099.zfglya (mgr.14116) 9 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi099", "addr": "172.21.15.99", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:16.191 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:14.917128+0000 mon.smithi099 (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:16.191 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:51:14.917440+0000 mgr.smithi099.zfglya (mgr.14116) 10 : cephadm [INF] Added host smithi099 2024-02-19T21:51:16.191 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:14.963989+0000 mon.smithi099 (mon.0) 54 : audit [DBG] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:51:16.821 INFO:teuthology.orchestra.run.smithi099.stderr:Deploying mgr service with default placement... 2024-02-19T21:51:17.346 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:16.159661+0000 mgr.smithi099.zfglya (mgr.14116) 11 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:17.413 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:51:16.160785+0000 mgr.smithi099.zfglya (mgr.14116) 12 : cephadm [INF] Saving service mon spec with placement count:5 2024-02-19T21:51:17.413 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:16.162903+0000 mon.smithi099 (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-02-19T21:51:18.540 INFO:teuthology.orchestra.run.smithi099.stderr:Deploying crash service with default placement... 2024-02-19T21:51:18.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:17.730610+0000 mgr.smithi099.zfglya (mgr.14116) 13 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:18.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:51:17.731463+0000 mgr.smithi099.zfglya (mgr.14116) 14 : cephadm [INF] Saving service mgr spec with placement count:2 2024-02-19T21:51:18.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:17.733755+0000 mon.smithi099 (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:19.206 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: Scheduled crash update... 2024-02-19T21:51:19.983 INFO:teuthology.orchestra.run.smithi099.stderr:Deploying prometheus service with default placement... 2024-02-19T21:51:20.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:19.204232+0000 mgr.smithi099.zfglya (mgr.14116) 15 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:20.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:51:19.205119+0000 mgr.smithi099.zfglya (mgr.14116) 16 : cephadm [INF] Saving service crash spec with placement * 2024-02-19T21:51:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:19.207414+0000 mon.smithi099 (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:19.444560+0000 mon.smithi099 (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:19.673870+0000 mon.smithi099 (mon.0) 59 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:20.701 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: Scheduled prometheus update... 2024-02-19T21:51:21.349 INFO:teuthology.orchestra.run.smithi099.stderr:Deploying grafana service with default placement... 2024-02-19T21:51:22.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:20.698277+0000 mgr.smithi099.zfglya (mgr.14116) 17 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:22.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:51:20.699129+0000 mgr.smithi099.zfglya (mgr.14116) 18 : cephadm [INF] Saving service prometheus spec with placement count:1 2024-02-19T21:51:22.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:20.701961+0000 mon.smithi099 (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:22.445 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: Scheduled grafana update... 2024-02-19T21:51:23.127 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:21.954233+0000 mon.smithi099 (mon.0) 61 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:23.127 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:22.185212+0000 mgr.smithi099.zfglya (mgr.14116) 19 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:51:23.128 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:22.442595+0000 mgr.smithi099.zfglya (mgr.14116) 20 : audit [DBG] from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:23.128 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:51:22.443420+0000 mgr.smithi099.zfglya (mgr.14116) 21 : cephadm [INF] Saving service grafana spec with placement count:1 2024-02-19T21:51:23.128 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:22.446215+0000 mon.smithi099 (mon.0) 62 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:23.395 INFO:teuthology.orchestra.run.smithi099.stderr:Deploying node-exporter service with default placement... 2024-02-19T21:51:24.147 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: Scheduled node-exporter update... 2024-02-19T21:51:24.856 INFO:teuthology.orchestra.run.smithi099.stderr:Deploying alertmanager service with default placement... 2024-02-19T21:51:25.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:24.144592+0000 mgr.smithi099.zfglya (mgr.14116) 22 : audit [DBG] from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:25.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:51:24.145399+0000 mgr.smithi099.zfglya (mgr.14116) 23 : cephadm [INF] Saving service node-exporter spec with placement * 2024-02-19T21:51:25.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:24.147521+0000 mon.smithi099 (mon.0) 63 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:25.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:24.185463+0000 mgr.smithi099.zfglya (mgr.14116) 24 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:51:25.591 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: Scheduled alertmanager update... 2024-02-19T21:51:26.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:25.588771+0000 mgr.smithi099.zfglya (mgr.14116) 25 : audit [DBG] from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:26.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:51:25.589553+0000 mgr.smithi099.zfglya (mgr.14116) 26 : cephadm [INF] Saving service alertmanager spec with placement count:1 2024-02-19T21:51:26.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:25.591839+0000 mon.smithi099 (mon.0) 64 : audit [INF] from='mgr.14116 172.21.15.99:0/1038605357' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:28.100 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:26.185773+0000 mgr.smithi099.zfglya (mgr.14116) 27 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:51:28.100 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:26.823879+0000 mon.smithi099 (mon.0) 65 : audit [INF] from='client.? 172.21.15.99:0/3762918220' entity='client.admin' 2024-02-19T21:51:28.709 INFO:teuthology.orchestra.run.smithi099.stderr:Enabling the dashboard module... 2024-02-19T21:51:29.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:28.072929+0000 mon.smithi099 (mon.0) 66 : audit [INF] from='client.? 172.21.15.99:0/3850359746' entity='client.admin' 2024-02-19T21:51:29.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:28.186022+0000 mgr.smithi099.zfglya (mgr.14116) 28 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:51:30.326 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:29.541380+0000 mon.smithi099 (mon.0) 67 : audit [INF] from='client.? 172.21.15.99:0/2307953817' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-19T21:51:31.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:30.081586+0000 mon.smithi099 (mon.0) 68 : audit [INF] from='client.? 172.21.15.99:0/2307953817' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-19T21:51:31.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:30.081652+0000 mon.smithi099 (mon.0) 69 : cluster [DBG] mgrmap e9: smithi099.zfglya(active, since 27s) 2024-02-19T21:51:31.552 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: { 2024-02-19T21:51:31.552 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 9, 2024-02-19T21:51:31.552 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "available": true, 2024-02-19T21:51:31.552 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "active_name": "smithi099.zfglya", 2024-02-19T21:51:31.552 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_standby": 0 2024-02-19T21:51:31.553 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: } 2024-02-19T21:51:32.313 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for the mgr to restart... 2024-02-19T21:51:32.313 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for mgr epoch 9... 2024-02-19T21:51:32.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:31.552297+0000 mon.smithi099 (mon.0) 70 : audit [DBG] from='client.? 172.21.15.99:0/3353167339' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-19T21:51:35.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:35.434207+0000 mon.smithi099 (mon.0) 71 : cluster [INF] Active manager daemon smithi099.zfglya restarted 2024-02-19T21:51:35.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:35.434439+0000 mon.smithi099 (mon.0) 72 : cluster [INF] Activating manager daemon smithi099.zfglya 2024-02-19T21:51:35.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:35.439645+0000 mon.smithi099 (mon.0) 73 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-02-19T21:51:35.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:35.439752+0000 mon.smithi099 (mon.0) 74 : cluster [DBG] mgrmap e10: smithi099.zfglya(active, starting, since 0.00540289s) 2024-02-19T21:51:35.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:35.440336+0000 mon.smithi099 (mon.0) 75 : audit [DBG] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-02-19T21:51:35.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:35.441108+0000 mon.smithi099 (mon.0) 76 : audit [DBG] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mgr metadata", "who": "smithi099.zfglya", "id": "smithi099.zfglya"}]: dispatch 2024-02-19T21:51:35.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:35.441720+0000 mon.smithi099 (mon.0) 77 : audit [DBG] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T21:51:35.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:35.441898+0000 mon.smithi099 (mon.0) 78 : audit [DBG] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T21:51:35.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:35.442023+0000 mon.smithi099 (mon.0) 79 : audit [DBG] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T21:51:35.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:35.455851+0000 mon.smithi099 (mon.0) 80 : cluster [INF] Manager daemon smithi099.zfglya is now available 2024-02-19T21:51:36.444 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: { 2024-02-19T21:51:36.444 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2024-02-19T21:51:36.445 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "initialized": true 2024-02-19T21:51:36.445 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: } 2024-02-19T21:51:36.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:35.548767+0000 mon.smithi099 (mon.0) 81 : audit [DBG] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:51:36.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:35.550181+0000 mon.smithi099 (mon.0) 82 : audit [DBG] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:51:36.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:35.574547+0000 mon.smithi099 (mon.0) 83 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.zfglya/mirror_snapshot_schedule"}]: dispatch 2024-02-19T21:51:36.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:35.578881+0000 mon.smithi099 (mon.0) 84 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.zfglya/trash_purge_schedule"}]: dispatch 2024-02-19T21:51:36.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:36.439101+0000 mon.smithi099 (mon.0) 85 : cluster [DBG] mgrmap e11: smithi099.zfglya(active, since 1.00475s) 2024-02-19T21:51:37.312 INFO:teuthology.orchestra.run.smithi099.stderr:mgr epoch 9 is available 2024-02-19T21:51:37.312 INFO:teuthology.orchestra.run.smithi099.stderr:Generating a dashboard self-signed certificate... 2024-02-19T21:51:38.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:36.438273+0000 mgr.smithi099.zfglya (mgr.14156) 1 : audit [DBG] from='client.14160 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-19T21:51:38.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:36.444934+0000 mgr.smithi099.zfglya (mgr.14156) 2 : audit [DBG] from='client.14160 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-19T21:51:38.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:36.944847+0000 mon.smithi099 (mon.0) 86 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:38.316 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: Self-signed certificate created 2024-02-19T21:51:39.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:37.946456+0000 mon.smithi099 (mon.0) 87 : cluster [DBG] mgrmap e12: smithi099.zfglya(active, since 2s) 2024-02-19T21:51:39.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:38.315079+0000 mon.smithi099 (mon.0) 88 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:39.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:38.316849+0000 mon.smithi099 (mon.0) 89 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:39.744 INFO:teuthology.orchestra.run.smithi099.stderr:Creating initial admin user... 2024-02-19T21:51:40.022 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:38.202169+0000 mgr.smithi099.zfglya (mgr.14156) 3 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$JegVuMPZF/XniCP0c4RfSeFKNEbInI8z32zCe2K/71CLZcrhDc44m", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1708379500, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-19T21:51:41.493 INFO:teuthology.orchestra.run.smithi099.stderr:Fetching dashboard port number... 2024-02-19T21:51:42.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:40.576246+0000 mgr.smithi099.zfglya (mgr.14156) 4 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:42.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:40.802536+0000 mon.smithi099 (mon.0) 90 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:42.229 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 8443 2024-02-19T21:51:42.912 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:41.806237+0000 mon.smithi099 (mon.0) 91 : cluster [DBG] mgrmap e13: smithi099.zfglya(active, since 6s) 2024-02-19T21:51:42.912 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:42.230730+0000 mon.smithi099 (mon.0) 92 : audit [DBG] from='client.? 172.21.15.99:0/1056316703' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-19T21:51:42.918 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: disabled 2024-02-19T21:51:42.925 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: inactive 2024-02-19T21:51:42.926 INFO:teuthology.orchestra.run.smithi099.stderr:firewalld.service is not enabled 2024-02-19T21:51:42.926 INFO:teuthology.orchestra.run.smithi099.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-19T21:51:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:Ceph Dashboard is now available at: 2024-02-19T21:51:42.929 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-19T21:51:42.929 INFO:teuthology.orchestra.run.smithi099.stderr: URL: https://smithi099.front.sepia.ceph.com:8443/ 2024-02-19T21:51:42.929 INFO:teuthology.orchestra.run.smithi099.stderr: User: admin 2024-02-19T21:51:42.929 INFO:teuthology.orchestra.run.smithi099.stderr: Password: zswdyz8dn9 2024-02-19T21:51:42.929 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-19T21:51:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:Enabling autotune for osd_memory_target 2024-02-19T21:51:45.105 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2024-02-19T21:51:45.768 INFO:teuthology.orchestra.run.smithi099.stderr:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-19T21:51:45.768 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-19T21:51:45.768 INFO:teuthology.orchestra.run.smithi099.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-19T21:51:45.768 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-19T21:51:45.768 INFO:teuthology.orchestra.run.smithi099.stderr:Or, if you are only running a single cluster on this host: 2024-02-19T21:51:45.769 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-19T21:51:45.769 INFO:teuthology.orchestra.run.smithi099.stderr: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-19T21:51:45.769 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-19T21:51:45.769 INFO:teuthology.orchestra.run.smithi099.stderr:Please consider enabling telemetry to help improve Ceph: 2024-02-19T21:51:45.769 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-19T21:51:45.769 INFO:teuthology.orchestra.run.smithi099.stderr: ceph telemetry on 2024-02-19T21:51:45.770 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-19T21:51:45.770 INFO:teuthology.orchestra.run.smithi099.stderr:For more information see: 2024-02-19T21:51:45.770 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-19T21:51:45.770 INFO:teuthology.orchestra.run.smithi099.stderr: https://docs.ceph.com/en/pacific/mgr/telemetry/ 2024-02-19T21:51:45.770 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-19T21:51:45.770 INFO:teuthology.orchestra.run.smithi099.stderr:Bootstrap complete. 2024-02-19T21:51:45.811 INFO:tasks.cephadm:Fetching config... 2024-02-19T21:51:45.811 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:51:45.811 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-19T21:51:45.831 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-19T21:51:45.831 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:51:45.831 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-19T21:51:45.889 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-19T21:51:45.889 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:51:45.889 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/keyring of=/dev/stdout 2024-02-19T21:51:45.956 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-19T21:51:45.956 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:51:45.957 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-19T21:51:46.015 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-19T21:51:46.015 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqf12JMrvUXNG3MGdIz+EppcKnDIZKVOknZ+DjroKrDSwGFZ1Fjmq7lDvSIFahpsNaJsGoMzO4f7FPB9c4S6/SZr1FmzzzVyTeiTKpA73i5QlNTF4upk0SBTFnVlcMfhX9KzhpWPbbPhgzF2fBFowUf657EG9P+m75Wm9JlU/xu83ija6sP1qjI/IRt9U/PsZYsXFZODseGcxv7Yd14xTOwVVqBa+H8JLti9byscBtDHw+QAbFBXqy3kf3uPUoIaWHmH+Q4+CxH5qhKjuKgwhWnEpRu/suvFUSsFCmclliMhqm5iVF47afCifJFTgJta9mQrO8UIdJySOepcU8YvwzI66ngI+E9cc6T71+jbe2RB147/S1I9uvTJmPVPEjVTwgBzKVisZhjO9xGULKjGNLlvuDLuhnfjw6vFn5DtjTOzjDbE3MebWLachc4mjV/tiySPa/VRGYV5ng9+vkCGbwfklZxD2TVAEQ6LPnplD7cfL1umLfytRqEE1Z+OfyQj0= ceph-d4704266-cf70-11ee-95bb-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-19T21:51:46.091 INFO:teuthology.orchestra.run.smithi099.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqf12JMrvUXNG3MGdIz+EppcKnDIZKVOknZ+DjroKrDSwGFZ1Fjmq7lDvSIFahpsNaJsGoMzO4f7FPB9c4S6/SZr1FmzzzVyTeiTKpA73i5QlNTF4upk0SBTFnVlcMfhX9KzhpWPbbPhgzF2fBFowUf657EG9P+m75Wm9JlU/xu83ija6sP1qjI/IRt9U/PsZYsXFZODseGcxv7Yd14xTOwVVqBa+H8JLti9byscBtDHw+QAbFBXqy3kf3uPUoIaWHmH+Q4+CxH5qhKjuKgwhWnEpRu/suvFUSsFCmclliMhqm5iVF47afCifJFTgJta9mQrO8UIdJySOepcU8YvwzI66ngI+E9cc6T71+jbe2RB147/S1I9uvTJmPVPEjVTwgBzKVisZhjO9xGULKjGNLlvuDLuhnfjw6vFn5DtjTOzjDbE3MebWLachc4mjV/tiySPa/VRGYV5ng9+vkCGbwfklZxD2TVAEQ6LPnplD7cfL1umLfytRqEE1Z+OfyQj0= ceph-d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:51:46.102 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqf12JMrvUXNG3MGdIz+EppcKnDIZKVOknZ+DjroKrDSwGFZ1Fjmq7lDvSIFahpsNaJsGoMzO4f7FPB9c4S6/SZr1FmzzzVyTeiTKpA73i5QlNTF4upk0SBTFnVlcMfhX9KzhpWPbbPhgzF2fBFowUf657EG9P+m75Wm9JlU/xu83ija6sP1qjI/IRt9U/PsZYsXFZODseGcxv7Yd14xTOwVVqBa+H8JLti9byscBtDHw+QAbFBXqy3kf3uPUoIaWHmH+Q4+CxH5qhKjuKgwhWnEpRu/suvFUSsFCmclliMhqm5iVF47afCifJFTgJta9mQrO8UIdJySOepcU8YvwzI66ngI+E9cc6T71+jbe2RB147/S1I9uvTJmPVPEjVTwgBzKVisZhjO9xGULKjGNLlvuDLuhnfjw6vFn5DtjTOzjDbE3MebWLachc4mjV/tiySPa/VRGYV5ng9+vkCGbwfklZxD2TVAEQ6LPnplD7cfL1umLfytRqEE1Z+OfyQj0= ceph-d4704266-cf70-11ee-95bb-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-19T21:51:46.147 INFO:teuthology.orchestra.run.smithi138.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqf12JMrvUXNG3MGdIz+EppcKnDIZKVOknZ+DjroKrDSwGFZ1Fjmq7lDvSIFahpsNaJsGoMzO4f7FPB9c4S6/SZr1FmzzzVyTeiTKpA73i5QlNTF4upk0SBTFnVlcMfhX9KzhpWPbbPhgzF2fBFowUf657EG9P+m75Wm9JlU/xu83ija6sP1qjI/IRt9U/PsZYsXFZODseGcxv7Yd14xTOwVVqBa+H8JLti9byscBtDHw+QAbFBXqy3kf3uPUoIaWHmH+Q4+CxH5qhKjuKgwhWnEpRu/suvFUSsFCmclliMhqm5iVF47afCifJFTgJta9mQrO8UIdJySOepcU8YvwzI66ngI+E9cc6T71+jbe2RB147/S1I9uvTJmPVPEjVTwgBzKVisZhjO9xGULKjGNLlvuDLuhnfjw6vFn5DtjTOzjDbE3MebWLachc4mjV/tiySPa/VRGYV5ng9+vkCGbwfklZxD2TVAEQ6LPnplD7cfL1umLfytRqEE1Z+OfyQj0= ceph-d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:51:46.159 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-19T21:51:46.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:45.103358+0000 mon.smithi099 (mon.0) 93 : audit [INF] from='client.? 172.21.15.99:0/3605225871' entity='client.admin' 2024-02-19T21:51:49.388 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-19T21:51:49.388 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-19T21:51:49.884 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:48.681979+0000 mon.smithi099 (mon.0) 94 : audit [INF] from='client.? 172.21.15.99:0/740714397' entity='client.admin' 2024-02-19T21:51:49.885 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:49.102815+0000 mon.smithi099 (mon.0) 95 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:49.885 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:49.529321+0000 mon.smithi099 (mon.0) 96 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:51:49.885 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:49.533863+0000 mon.smithi099 (mon.0) 97 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:50.900 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:51:49.542062+0000 mgr.smithi099.zfglya (mgr.14156) 5 : cephadm [INF] Deploying daemon alertmanager.smithi099 on smithi099 2024-02-19T21:51:52.953 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi138 2024-02-19T21:51:52.954 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-19T21:51:52.954 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/etc/ceph/ceph.conf 2024-02-19T21:51:52.975 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-19T21:51:52.975 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:51:53.036 INFO:tasks.cephadm:Adding host smithi138 to orchestrator... 2024-02-19T21:51:53.036 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph orch host add smithi138 2024-02-19T21:51:53.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:52.264782+0000 mgr.smithi099.zfglya (mgr.14156) 6 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:51:53.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:52.267292+0000 mon.smithi099 (mon.0) 98 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:51:56.894 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:55.443173+0000 mgr.smithi099.zfglya (mgr.14156) 7 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:51:58.817 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:51:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:57.443423+0000 mgr.smithi099.zfglya (mgr.14156) 8 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:00.877 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:51:59.443652+0000 mgr.smithi099.zfglya (mgr.14156) 9 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:00.877 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:59.573560+0000 mon.smithi099 (mon.0) 99 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:00.877 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:59.574972+0000 mon.smithi099 (mon.0) 100 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T21:52:00.877 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:59.576654+0000 mon.smithi099 (mon.0) 101 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-19T21:52:00.877 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:51:59.577228+0000 mon.smithi099 (mon.0) 102 : audit [DBG] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:52:00.877 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:51:59.577708+0000 mgr.smithi099.zfglya (mgr.14156) 10 : cephadm [INF] Deploying daemon crash.smithi099 on smithi099 2024-02-19T21:52:01.696 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:00.576384+0000 mon.smithi099 (mon.0) 103 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:03.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:01.443865+0000 mgr.smithi099.zfglya (mgr.14156) 11 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:03.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:01.792760+0000 mon.smithi099 (mon.0) 104 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:03.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:01.832794+0000 mon.smithi099 (mon.0) 105 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:03.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:01.834603+0000 mon.smithi099 (mon.0) 106 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:03.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:01.836508+0000 mon.smithi099 (mon.0) 107 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-19T21:52:03.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:01.836827+0000 mgr.smithi099.zfglya (mgr.14156) 12 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-19T21:52:03.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:01.839939+0000 mon.smithi099 (mon.0) 108 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:03.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:52:01.846470+0000 mgr.smithi099.zfglya (mgr.14156) 13 : cephadm [INF] Deploying daemon grafana.smithi099 on smithi099 2024-02-19T21:52:05.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:03.444126+0000 mgr.smithi099.zfglya (mgr.14156) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:06.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:05.444317+0000 mgr.smithi099.zfglya (mgr.14156) 15 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:06.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:05.579314+0000 mon.smithi099 (mon.0) 109 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:08.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:07.444525+0000 mgr.smithi099.zfglya (mgr.14156) 16 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:10.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:09.444745+0000 mgr.smithi099.zfglya (mgr.14156) 17 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:12.922 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:11.444967+0000 mgr.smithi099.zfglya (mgr.14156) 18 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:14.941 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:13.445330+0000 mgr.smithi099.zfglya (mgr.14156) 19 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:16.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:15.066709+0000 mon.smithi099 (mon.0) 110 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:16.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:52:15.068701+0000 mgr.smithi099.zfglya (mgr.14156) 20 : cephadm [INF] Deploying daemon node-exporter.smithi099 on smithi099 2024-02-19T21:52:16.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:15.586442+0000 mon.smithi099 (mon.0) 111 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:17.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:15.445538+0000 mgr.smithi099.zfglya (mgr.14156) 21 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:19.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:17.445906+0000 mgr.smithi099.zfglya (mgr.14156) 22 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:19.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:18.051264+0000 mon.smithi099 (mon.0) 112 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:19.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:18.053379+0000 mon.smithi099 (mon.0) 113 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-19T21:52:20.378 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:19.053849+0000 mon.smithi099 (mon.0) 114 : audit [INF] from='mgr.14156 172.21.15.99:0/3866424812' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-19T21:52:20.378 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:19.053912+0000 mon.smithi099 (mon.0) 115 : cluster [DBG] mgrmap e14: smithi099.zfglya(active, since 43s) 2024-02-19T21:52:24.615 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:24.301048+0000 mon.smithi099 (mon.0) 116 : cluster [INF] Active manager daemon smithi099.zfglya restarted 2024-02-19T21:52:24.615 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:24.301357+0000 mon.smithi099 (mon.0) 117 : cluster [INF] Activating manager daemon smithi099.zfglya 2024-02-19T21:52:24.615 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:24.304060+0000 mon.smithi099 (mon.0) 118 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-19T21:52:24.615 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:24.304162+0000 mon.smithi099 (mon.0) 119 : cluster [DBG] mgrmap e15: smithi099.zfglya(active, starting, since 0.00294002s) 2024-02-19T21:52:24.616 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:24.305200+0000 mon.smithi099 (mon.0) 120 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-02-19T21:52:24.616 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:24.305833+0000 mon.smithi099 (mon.0) 121 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mgr metadata", "who": "smithi099.zfglya", "id": "smithi099.zfglya"}]: dispatch 2024-02-19T21:52:24.616 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:24.306447+0000 mon.smithi099 (mon.0) 122 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T21:52:24.616 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:24.306591+0000 mon.smithi099 (mon.0) 123 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T21:52:24.616 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:24.306729+0000 mon.smithi099 (mon.0) 124 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T21:52:24.616 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:24.320653+0000 mon.smithi099 (mon.0) 125 : cluster [INF] Manager daemon smithi099.zfglya is now available 2024-02-19T21:52:25.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:24.413235+0000 mon.smithi099 (mon.0) 126 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:52:25.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:24.415702+0000 mon.smithi099 (mon.0) 127 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:52:25.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:24.438777+0000 mon.smithi099 (mon.0) 128 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:25.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:24.447082+0000 mon.smithi099 (mon.0) 129 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.zfglya/mirror_snapshot_schedule"}]: dispatch 2024-02-19T21:52:25.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:24.451188+0000 mon.smithi099 (mon.0) 130 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.zfglya/trash_purge_schedule"}]: dispatch 2024-02-19T21:52:25.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:25.306808+0000 mon.smithi099 (mon.0) 131 : cluster [DBG] mgrmap e16: smithi099.zfglya(active, since 1.00558s) 2024-02-19T21:52:27.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:26.356406+0000 mon.smithi099 (mon.0) 132 : cluster [DBG] mgrmap e17: smithi099.zfglya(active, since 2s) 2024-02-19T21:52:29.186 INFO:teuthology.orchestra.run.smithi138.stdout:Added host 'smithi138' with addr '172.21.15.138' 2024-02-19T21:52:29.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:27.860858+0000 mon.smithi099 (mon.0) 133 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:29.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:28.139065+0000 mon.smithi099 (mon.0) 134 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:52:29.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:28.139864+0000 mon.smithi099 (mon.0) 135 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:52:29.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:28.140398+0000 mon.smithi099 (mon.0) 136 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:52:29.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:28.186589+0000 mon.smithi099 (mon.0) 137 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:29.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:28.191290+0000 mon.smithi099 (mon.0) 138 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:29.768 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph orch host ls --format=json 2024-02-19T21:52:30.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:52:28.141384+0000 mgr.smithi099.zfglya (mgr.14180) 1 : cephadm [INF] Updating smithi099:/etc/ceph/ceph.conf 2024-02-19T21:52:30.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:52:28.158407+0000 mgr.smithi099.zfglya (mgr.14180) 2 : cephadm [INF] Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:52:30.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:52:28.202343+0000 mgr.smithi099.zfglya (mgr.14180) 3 : cephadm [INF] Deploying daemon prometheus.smithi099 on smithi099 2024-02-19T21:52:30.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:28.559163+0000 mgr.smithi099.zfglya (mgr.14180) 4 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi138", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:52:30.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:29.185356+0000 mon.smithi099 (mon.0) 139 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:31.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:52:29.185708+0000 mgr.smithi099.zfglya (mgr.14180) 5 : cephadm [INF] Added host smithi138 2024-02-19T21:52:31.824 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:52:31.824 INFO:teuthology.orchestra.run.smithi138.stdout:[{"addr": "172.21.15.99", "hostname": "smithi099", "labels": [], "status": ""}, {"addr": "172.21.15.138", "hostname": "smithi138", "labels": [], "status": ""}] 2024-02-19T21:52:32.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:31.824047+0000 mgr.smithi099.zfglya (mgr.14180) 6 : audit [DBG] from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:52:32.547 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-19T21:52:32.547 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph osd crush tunables default 2024-02-19T21:52:36.091 INFO:teuthology.orchestra.run.smithi099.stderr:adjusted tunables profile to default 2024-02-19T21:52:36.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:36.035648+0000 mon.smithi099 (mon.0) 140 : audit [INF] from='client.? 172.21.15.99:0/2919719313' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-19T21:52:36.916 INFO:tasks.cephadm:Adding mon.smithi099 on smithi099 2024-02-19T21:52:36.916 INFO:tasks.cephadm:Adding mon.smithi138 on smithi138 2024-02-19T21:52:36.916 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph orch apply mon '2;smithi099:172.21.15.99=smithi099;smithi138:172.21.15.138=smithi138' 2024-02-19T21:52:37.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:36.088235+0000 mon.smithi099 (mon.0) 141 : audit [INF] from='client.? 172.21.15.99:0/2919719313' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-19T21:52:37.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:36.088275+0000 mon.smithi099 (mon.0) 142 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-19T21:52:40.995 INFO:teuthology.orchestra.run.smithi138.stdout:Scheduled mon update... 2024-02-19T21:52:41.732 DEBUG:teuthology.orchestra.run.smithi138:mon.smithi138> sudo journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@mon.smithi138.service 2024-02-19T21:52:41.734 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T21:52:41.735 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T21:52:41.762 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:-- Logs begin at Mon 2024-02-19 21:38:16 UTC. -- 2024-02-19T21:52:42.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:40.989329+0000 mgr.smithi099.zfglya (mgr.14180) 7 : audit [DBG] from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi099:172.21.15.99=smithi099;smithi138:172.21.15.138=smithi138", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:52:42.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:52:40.991366+0000 mgr.smithi099.zfglya (mgr.14180) 8 : cephadm [INF] Saving service mon spec with placement smithi099:172.21.15.99=smithi099;smithi138:172.21.15.138=smithi138;count:2 2024-02-19T21:52:42.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:40.994607+0000 mon.smithi099 (mon.0) 143 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:52:43.830 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"d4704266-cf70-11ee-95bb-87774f69a715","modified":"2024-02-19T21:50:37.062089Z","created":"2024-02-19T21:50:37.062089Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T21:52:43.833 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-19T21:52:44.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:43.083755+0000 mon.smithi099 (mon.0) 144 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:44.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:43.084952+0000 mon.smithi099 (mon.0) 145 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:52:44.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:43.536856+0000 mon.smithi099 (mon.0) 146 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:44.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:43.793464+0000 mon.smithi099 (mon.0) 147 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:44.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:43.831154+0000 mon.smithi099 (mon.0) 148 : audit [DBG] from='client.? 172.21.15.138:0/316021296' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:52:45.491 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T21:52:45.491 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T21:52:45.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:44.307872+0000 mgr.smithi099.zfglya (mgr.14180) 9 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:45.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:44.441176+0000 mon.smithi099 (mon.0) 149 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:47.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:46.308142+0000 mgr.smithi099.zfglya (mgr.14180) 10 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:52:48.652 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"d4704266-cf70-11ee-95bb-87774f69a715","modified":"2024-02-19T21:50:37.062089Z","created":"2024-02-19T21:50:37.062089Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T21:52:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-19T21:52:49.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:47.986122+0000 mon.smithi099 (mon.0) 150 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:49.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:48.313329+0000 mon.smithi099 (mon.0) 151 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:49.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:48.313955+0000 mon.smithi099 (mon.0) 152 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd/host:smithi138", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:52:49.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:48.594228+0000 mon.smithi099 (mon.0) 153 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:49.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:48.594877+0000 mon.smithi099 (mon.0) 154 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:52:49.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:48.595506+0000 mon.smithi099 (mon.0) 155 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:52:49.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:48.643385+0000 mon.smithi099 (mon.0) 156 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:49.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:48.646134+0000 mon.smithi099 (mon.0) 157 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:52:49.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:48.647407+0000 mon.smithi099 (mon.0) 158 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T21:52:49.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:48.649661+0000 mon.smithi099 (mon.0) 159 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-19T21:52:49.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:48.650195+0000 mon.smithi099 (mon.0) 160 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:52:49.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:52:48.653056+0000 mon.smithi099 (mon.0) 161 : audit [DBG] from='client.? 172.21.15.138:0/3503817830' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:52:50.294 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T21:52:50.295 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T21:52:50.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:48.308489+0000 mgr.smithi099.zfglya (mgr.14180) 11 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:50.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:52:48.596439+0000 mgr.smithi099.zfglya (mgr.14180) 12 : cephadm [INF] Updating smithi138:/etc/ceph/ceph.conf 2024-02-19T21:52:50.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:52:48.615626+0000 mgr.smithi099.zfglya (mgr.14180) 13 : cephadm [INF] Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:52:50.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:52:48.650651+0000 mgr.smithi099.zfglya (mgr.14180) 14 : cephadm [INF] Deploying daemon crash.smithi138 on smithi138 2024-02-19T21:52:52.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:50.308843+0000 mgr.smithi099.zfglya (mgr.14180) 15 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:54.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:52.309187+0000 mgr.smithi099.zfglya (mgr.14180) 16 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:56.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:54.309567+0000 mgr.smithi099.zfglya (mgr.14180) 17 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:52:58.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:56.309940+0000 mgr.smithi099.zfglya (mgr.14180) 18 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:00.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:52:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:52:58.310230+0000 mgr.smithi099.zfglya (mgr.14180) 19 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:00.310595+0000 mgr.smithi099.zfglya (mgr.14180) 20 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:00.776889+0000 mon.smithi099 (mon.0) 162 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:00.778947+0000 mon.smithi099 (mon.0) 163 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.yvypfr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T21:53:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:00.780849+0000 mon.smithi099 (mon.0) 164 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.yvypfr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-19T21:53:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:00.781555+0000 mon.smithi099 (mon.0) 165 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T21:53:02.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:00.782312+0000 mon.smithi099 (mon.0) 166 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:02.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:00.782860+0000 mgr.smithi099.zfglya (mgr.14180) 21 : cephadm [INF] Deploying daemon mgr.smithi138.yvypfr on smithi138 2024-02-19T21:53:02.210 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:53:02.210 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"d4704266-cf70-11ee-95bb-87774f69a715","modified":"2024-02-19T21:50:37.062089Z","created":"2024-02-19T21:50:37.062089Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T21:53:02.212 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-19T21:53:03.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:02.211213+0000 mon.smithi099 (mon.0) 167 : audit [DBG] from='client.? 172.21.15.138:0/378482085' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:53:04.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:02.310960+0000 mgr.smithi099.zfglya (mgr.14180) 22 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:04.777 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T21:53:04.778 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T21:53:05.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:04.311288+0000 mgr.smithi099.zfglya (mgr.14180) 23 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:05.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:04.397416+0000 mon.smithi099 (mon.0) 168 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:05.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:04.399432+0000 mon.smithi099 (mon.0) 169 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:53:05.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:04.400188+0000 mon.smithi099 (mon.0) 170 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:05.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:04.400824+0000 mgr.smithi099.zfglya (mgr.14180) 24 : cephadm [INF] Deploying daemon mon.smithi138 on smithi138 2024-02-19T21:53:05.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:04.447006+0000 mon.smithi099 (mon.0) 171 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:07.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:06.311667+0000 mgr.smithi099.zfglya (mgr.14180) 25 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:07.776 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:53:07.777 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"d4704266-cf70-11ee-95bb-87774f69a715","modified":"2024-02-19T21:50:37.062089Z","created":"2024-02-19T21:50:37.062089Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T21:53:07.779 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-02-19T21:53:08.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:07.777724+0000 mon.smithi099 (mon.0) 172 : audit [DBG] from='client.? 172.21.15.138:0/2228928749' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:53:09.424 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T21:53:09.425 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T21:53:09.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:08.312082+0000 mgr.smithi099.zfglya (mgr.14180) 26 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:09.731 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:09 smithi138 systemd[1]: Starting Ceph mon.smithi138 for d4704266-cf70-11ee-95bb-87774f69a715... 2024-02-19T21:53:10.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:09.744805+0000 mon.smithi099 (mon.0) 173 : cluster [DBG] Standby manager daemon smithi138.yvypfr started 2024-02-19T21:53:10.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:09.750039+0000 mon.smithi099 (mon.0) 174 : audit [DBG] from='mgr.? 172.21.15.138:0/2349372067' entity='mgr.smithi138.yvypfr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.yvypfr/crt"}]: dispatch 2024-02-19T21:53:10.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:09.750444+0000 mon.smithi099 (mon.0) 175 : audit [DBG] from='mgr.? 172.21.15.138:0/2349372067' entity='mgr.smithi138.yvypfr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T21:53:10.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:09.753250+0000 mon.smithi099 (mon.0) 176 : audit [DBG] from='mgr.? 172.21.15.138:0/2349372067' entity='mgr.smithi138.yvypfr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.yvypfr/key"}]: dispatch 2024-02-19T21:53:10.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:09.754838+0000 mon.smithi099 (mon.0) 177 : audit [DBG] from='mgr.? 172.21.15.138:0/2349372067' entity='mgr.smithi138.yvypfr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T21:53:10.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.531+0000 7f806f282880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-19T21:53:10.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.531+0000 7f806f282880 0 ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable), process ceph-mon, pid 7 2024-02-19T21:53:10.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.531+0000 7f806f282880 0 pidfile_write: ignore empty --pid-file 2024-02-19T21:53:10.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.535+0000 7f806f282880 0 load: jerasure load: lrc load: isa 2024-02-19T21:53:10.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: RocksDB version: 6.8.1 2024-02-19T21:53:10.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-19T21:53:10.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Compile date Feb 17 2024 2024-02-19T21:53:10.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: DB SUMMARY 2024-02-19T21:53:10.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: CURRENT file: CURRENT 2024-02-19T21:53:10.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-19T21:53:10.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-02-19T21:53:10.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi138/store.db dir, Total Num: 0, files: 2024-02-19T21:53:10.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi138/store.db: 000003.log size: 511 ; 2024-02-19T21:53:10.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.error_if_exists: 0 2024-02-19T21:53:10.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.create_if_missing: 0 2024-02-19T21:53:10.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.paranoid_checks: 1 2024-02-19T21:53:10.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.env: 0x5587cd610080 2024-02-19T21:53:10.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.fs: Posix File System 2024-02-19T21:53:10.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.info_log: 0x5587cf8d6560 2024-02-19T21:53:10.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-19T21:53:10.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.statistics: (nil) 2024-02-19T21:53:10.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.use_fsync: 0 2024-02-19T21:53:10.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_log_file_size: 0 2024-02-19T21:53:10.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-19T21:53:10.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-19T21:53:10.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-19T21:53:10.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-19T21:53:10.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.allow_fallocate: 1 2024-02-19T21:53:10.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-19T21:53:10.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-19T21:53:10.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.use_direct_reads: 0 2024-02-19T21:53:10.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-19T21:53:10.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-19T21:53:10.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.db_log_dir: 2024-02-19T21:53:10.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi138/store.db 2024-02-19T21:53:10.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-19T21:53:10.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_subcompactions: 1 2024-02-19T21:53:10.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_background_flushes: -1 2024-02-19T21:53:10.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-19T21:53:10.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-19T21:53:10.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-19T21:53:10.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-19T21:53:10.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-19T21:53:10.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-19T21:53:10.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-19T21:53:10.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.write_buffer_manager: 0x5587d0546450 2024-02-19T21:53:10.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-19T21:53:10.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-19T21:53:10.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-19T21:53:10.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-19T21:53:10.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-19T21:53:10.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-19T21:53:10.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-19T21:53:10.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-19T21:53:10.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-19T21:53:10.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.unordered_write: 0 2024-02-19T21:53:10.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-19T21:53:10.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-19T21:53:10.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-19T21:53:10.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-19T21:53:10.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.row_cache: None 2024-02-19T21:53:10.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.wal_filter: None 2024-02-19T21:53:10.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.preserve_deletes: 0 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.two_write_queues: 0 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.atomic_flush: 0 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.log_readahead_size: 0 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_background_jobs: 2 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_background_compactions: -1 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-19T21:53:10.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-19T21:53:10.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-19T21:53:10.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-19T21:53:10.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-19T21:53:10.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-19T21:53:10.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-19T21:53:10.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_open_files: -1 2024-02-19T21:53:10.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-19T21:53:10.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-19T21:53:10.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-19T21:53:10.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-19T21:53:10.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Compression algorithms supported: 2024-02-19T21:53:10.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-19T21:53:10.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: kZSTD supported: 0 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: kXpressCompression supported: 0 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: kLZ4Compression supported: 1 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: kBZip2Compression supported: 0 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: kZlibCompression supported: 1 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: kSnappyCompression supported: 1 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi138/store.db/MANIFEST-000001 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.merge_operator: 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compaction_filter: None 2024-02-19T21:53:10.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5587cf87bd10) 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cache_index_and_filter_blocks: 1 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: pin_top_level_index_and_filter: 1 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: index_type: 0 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: data_block_index_type: 0 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: index_shortening: 1 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: data_block_hash_table_util_ratio: 0.750000 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: hash_index_allow_collision: 1 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: checksum: 1 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: no_block_cache: 0 2024-02-19T21:53:10.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: block_cache: 0x5587cf8b0f10 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: block_cache_name: BinnedLRUCache 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: block_cache_options: 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: capacity : 536870912 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: num_shard_bits : 4 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: strict_capacity_limit : 0 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: high_pri_pool_ratio: 0.000 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: block_cache_compressed: (nil) 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: persistent_cache: (nil) 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: block_size: 4096 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: block_size_deviation: 10 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: block_restart_interval: 16 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: index_block_restart_interval: 1 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: metadata_block_size: 4096 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: partition_filters: 0 2024-02-19T21:53:10.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: use_delta_encoding: 1 2024-02-19T21:53:10.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-19T21:53:10.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: whole_key_filtering: 1 2024-02-19T21:53:10.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: verify_compression: 0 2024-02-19T21:53:10.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: read_amp_bytes_per_bit: 0 2024-02-19T21:53:10.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: format_version: 2 2024-02-19T21:53:10.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: enable_index_compression: 1 2024-02-19T21:53:10.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: block_align: 0 2024-02-19T21:53:10.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-19T21:53:10.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-19T21:53:10.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compression: NoCompression 2024-02-19T21:53:10.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-19T21:53:10.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-19T21:53:10.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-19T21:53:10.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.num_levels: 7 2024-02-19T21:53:10.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-19T21:53:10.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-19T21:53:10.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-19T21:53:10.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-19T21:53:10.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-19T21:53:10.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-19T21:53:10.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-19T21:53:10.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-19T21:53:10.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-19T21:53:10.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-19T21:53:10.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-19T21:53:10.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-19T21:53:10.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-19T21:53:10.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-19T21:53:10.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-19T21:53:10.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-19T21:53:10.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-19T21:53:10.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-19T21:53:10.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-19T21:53:10.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-19T21:53:10.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-19T21:53:10.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-19T21:53:10.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-19T21:53:10.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-19T21:53:10.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-19T21:53:10.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-19T21:53:10.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-19T21:53:10.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-19T21:53:10.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-19T21:53:10.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-19T21:53:10.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-19T21:53:10.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-19T21:53:10.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-19T21:53:10.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-19T21:53:10.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-19T21:53:10.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-19T21:53:10.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-19T21:53:10.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-19T21:53:10.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-19T21:53:10.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-19T21:53:10.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-19T21:53:10.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-19T21:53:10.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-19T21:53:10.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-19T21:53:10.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-19T21:53:10.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-19T21:53:10.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.table_properties_collectors: 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.inplace_update_support: 0 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.bloom_locality: 0 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.max_successive_merges: 0 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.ttl: 2592000 2024-02-19T21:53:10.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-19T21:53:10.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.536+0000 7f806f282880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi138/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-19T21:53:10.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.537+0000 7f806f282880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-19T21:53:10.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.537+0000 7f806f282880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708379590538640, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-02-19T21:53:10.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.537+0000 7f806f282880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2024-02-19T21:53:10.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.537+0000 7f806f282880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-19T21:53:10.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.537+0000 7f806f282880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708379590539082, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708379590, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-19T21:53:10.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.537+0000 7f806f282880 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2024-02-19T21:53:10.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.537+0000 7f806f282880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708379590539450, "job": 1, "event": "recovery_finished"} 2024-02-19T21:53:10.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.538+0000 7f806f282880 4 rocksdb: DB pointer 0x5587cf979800 2024-02-19T21:53:10.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.538+0000 7f8056074700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-19T21:53:10.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.538+0000 7f8056074700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-19T21:53:10.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: ** DB Stats ** 2024-02-19T21:53:10.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:53:10.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-19T21:53:10.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T21:53:10.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T21:53:10.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-19T21:53:10.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-19T21:53:10.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T21:53:10.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: ** Compaction Stats [default] ** 2024-02-19T21:53:10.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:53:10.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:53:10.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2024-02-19T21:53:10.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2024-02-19T21:53:10.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2024-02-19T21:53:10.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: ** Compaction Stats [default] ** 2024-02-19T21:53:10.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:53:10.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:53:10.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2024-02-19T21:53:10.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:53:10.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T21:53:10.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T21:53:10.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T21:53:10.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T21:53:10.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: AddFile(Keys): cumulative 0, interval 0 2024-02-19T21:53:10.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:53:10.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:53:10.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T21:53:10.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: ** File Read Latency Histogram By Level [default] ** 2024-02-19T21:53:10.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: ** Compaction Stats [default] ** 2024-02-19T21:53:10.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:53:10.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:53:10.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2024-02-19T21:53:10.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2024-02-19T21:53:10.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-19T21:53:10.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: ** Compaction Stats [default] ** 2024-02-19T21:53:10.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-19T21:53:10.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T21:53:10.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2024-02-19T21:53:10.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T21:53:10.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T21:53:10.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T21:53:10.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T21:53:10.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T21:53:10.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: AddFile(Keys): cumulative 0, interval 0 2024-02-19T21:53:10.815 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:53:10.815 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T21:53:10.815 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T21:53:10.815 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.815 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: ** File Read Latency Histogram By Level [default] ** 2024-02-19T21:53:10.815 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.815 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.538+0000 7f806f282880 0 mon.smithi138 does not exist in monmap, will attempt to join an existing cluster 2024-02-19T21:53:10.815 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.538+0000 7f806f282880 0 using public_addr v2:172.21.15.138:0/0 -> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-02-19T21:53:10.815 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.539+0000 7f806f282880 0 starting mon.smithi138 rank -1 at public addrs [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] at bind addrs [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi138 fsid d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:53:10.815 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.540+0000 7f806f282880 1 mon.smithi138@-1(???) e0 preinit fsid d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:53:10.815 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.566+0000 7f8058879700 0 mon.smithi138@-1(synchronizing).mds e1 new map 2024-02-19T21:53:10.815 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.566+0000 7f8058879700 0 mon.smithi138@-1(synchronizing).mds e1 print_map 2024-02-19T21:53:10.816 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: e1 2024-02-19T21:53:10.816 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T21:53:10.816 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T21:53:10.816 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: legacy client fscid: -1 2024-02-19T21:53:10.816 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.816 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: No filesystems configured 2024-02-19T21:53:10.816 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: 2024-02-19T21:53:10.816 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.566+0000 7f8058879700 1 mon.smithi138@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-19T21:53:10.816 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.567+0000 7f8058879700 1 mon.smithi138@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-19T21:53:10.816 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.567+0000 7f8058879700 1 mon.smithi138@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-19T21:53:10.816 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.567+0000 7f8058879700 1 mon.smithi138@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-19T21:53:10.816 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.567+0000 7f8058879700 1 mon.smithi138@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-19T21:53:10.816 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.567+0000 7f8058879700 1 mon.smithi138@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-19T21:53:10.816 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.567+0000 7f8058879700 1 mon.smithi138@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-02-19T21:53:10.817 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.567+0000 7f8058879700 0 mon.smithi138@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-19T21:53:10.817 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.567+0000 7f8058879700 0 mon.smithi138@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:53:10.817 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.567+0000 7f8058879700 0 mon.smithi138@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:53:10.817 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.567+0000 7f8058879700 0 mon.smithi138@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T21:53:10.817 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:09.744805+0000 mon.smithi099 (mon.0) 173 : cluster [DBG] Standby manager daemon smithi138.yvypfr started 2024-02-19T21:53:10.817 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:09.750039+0000 mon.smithi099 (mon.0) 174 : audit [DBG] from='mgr.? 172.21.15.138:0/2349372067' entity='mgr.smithi138.yvypfr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.yvypfr/crt"}]: dispatch 2024-02-19T21:53:10.817 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:09.750444+0000 mon.smithi099 (mon.0) 175 : audit [DBG] from='mgr.? 172.21.15.138:0/2349372067' entity='mgr.smithi138.yvypfr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T21:53:10.817 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:09.753250+0000 mon.smithi099 (mon.0) 176 : audit [DBG] from='mgr.? 172.21.15.138:0/2349372067' entity='mgr.smithi138.yvypfr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.yvypfr/key"}]: dispatch 2024-02-19T21:53:10.817 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:09.754838+0000 mon.smithi099 (mon.0) 177 : audit [DBG] from='mgr.? 172.21.15.138:0/2349372067' entity='mgr.smithi138.yvypfr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T21:53:10.817 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T21:53:10.567+0000 7f8058879700 1 mon.smithi138@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-02-19T21:53:12.184 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:11 smithi138 bash[39774]: 91eae1efe25580a09344625d14084173427ed580cecb0d4fa01624b5948d2496 2024-02-19T21:53:12.184 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:11 smithi138 systemd[1]: Started Ceph mon.smithi138 for d4704266-cf70-11ee-95bb-87774f69a715. 2024-02-19T21:53:15.942 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:10.312424+0000 mgr.smithi099.zfglya (mgr.14180) 27 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:15.942 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:10.576565+0000 mon.smithi099 (mon.0) 181 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-02-19T21:53:15.942 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:10.576806+0000 mon.smithi099 (mon.0) 182 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-19T21:53:15.942 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:10.576944+0000 mon.smithi099 (mon.0) 183 : cluster [INF] mon.smithi099 calling monitor election 2024-02-19T21:53:15.942 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:11.573483+0000 mon.smithi099 (mon.0) 184 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-19T21:53:15.942 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:12.312774+0000 mgr.smithi099.zfglya (mgr.14180) 28 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:15.942 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:12.573520+0000 mon.smithi099 (mon.0) 185 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-19T21:53:15.942 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:12.574314+0000 mon.smithi138 (mon.1) 1 : cluster [INF] mon.smithi138 calling monitor election 2024-02-19T21:53:15.942 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:13.573721+0000 mon.smithi099 (mon.0) 186 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-19T21:53:15.943 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:14.313148+0000 mgr.smithi099.zfglya (mgr.14180) 29 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:15.943 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:14.573644+0000 mon.smithi099 (mon.0) 187 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-19T21:53:15.943 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:15.573650+0000 mon.smithi099 (mon.0) 188 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-19T21:53:15.943 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:15.603644+0000 mon.smithi099 (mon.0) 189 : cluster [INF] mon.smithi099 is new leader, mons smithi099,smithi138 in quorum (ranks 0,1) 2024-02-19T21:53:15.943 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:15.607774+0000 mon.smithi099 (mon.0) 190 : cluster [DBG] monmap e2: 2 mons at {smithi099=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0]} removed_ranks: {} 2024-02-19T21:53:15.943 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:15.619894+0000 mon.smithi099 (mon.0) 191 : cluster [DBG] fsmap 2024-02-19T21:53:15.943 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:15.619945+0000 mon.smithi099 (mon.0) 192 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-19T21:53:15.943 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:15.620341+0000 mon.smithi099 (mon.0) 193 : cluster [DBG] mgrmap e18: smithi099.zfglya(active, since 51s), standbys: smithi138.yvypfr 2024-02-19T21:53:15.943 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:15.620480+0000 mon.smithi099 (mon.0) 194 : cluster [INF] overall HEALTH_OK 2024-02-19T21:53:15.943 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:15.623938+0000 mon.smithi099 (mon.0) 195 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:15.946 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-19T21:53:15.946 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":2,"fsid":"d4704266-cf70-11ee-95bb-87774f69a715","modified":"2024-02-19T21:53:10.573538Z","created":"2024-02-19T21:50:37.062089Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-19T21:53:15.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:10.312424+0000 mgr.smithi099.zfglya (mgr.14180) 27 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:15.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:10.576565+0000 mon.smithi099 (mon.0) 181 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-02-19T21:53:15.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:10.576806+0000 mon.smithi099 (mon.0) 182 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-19T21:53:15.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:10.576944+0000 mon.smithi099 (mon.0) 183 : cluster [INF] mon.smithi099 calling monitor election 2024-02-19T21:53:15.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:11.573483+0000 mon.smithi099 (mon.0) 184 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-19T21:53:15.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:12.312774+0000 mgr.smithi099.zfglya (mgr.14180) 28 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:15.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:12.573520+0000 mon.smithi099 (mon.0) 185 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-19T21:53:15.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:12.574314+0000 mon.smithi138 (mon.1) 1 : cluster [INF] mon.smithi138 calling monitor election 2024-02-19T21:53:15.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:13.573721+0000 mon.smithi099 (mon.0) 186 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-19T21:53:15.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:14.313148+0000 mgr.smithi099.zfglya (mgr.14180) 29 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:15.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:14.573644+0000 mon.smithi099 (mon.0) 187 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-19T21:53:15.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:15.573650+0000 mon.smithi099 (mon.0) 188 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-19T21:53:15.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:15.603644+0000 mon.smithi099 (mon.0) 189 : cluster [INF] mon.smithi099 is new leader, mons smithi099,smithi138 in quorum (ranks 0,1) 2024-02-19T21:53:15.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:15.607774+0000 mon.smithi099 (mon.0) 190 : cluster [DBG] monmap e2: 2 mons at {smithi099=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0]} removed_ranks: {} 2024-02-19T21:53:15.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:15.619894+0000 mon.smithi099 (mon.0) 191 : cluster [DBG] fsmap 2024-02-19T21:53:15.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:15.619945+0000 mon.smithi099 (mon.0) 192 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-19T21:53:15.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:15.620341+0000 mon.smithi099 (mon.0) 193 : cluster [DBG] mgrmap e18: smithi099.zfglya(active, since 51s), standbys: smithi138.yvypfr 2024-02-19T21:53:15.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:15.620480+0000 mon.smithi099 (mon.0) 194 : cluster [INF] overall HEALTH_OK 2024-02-19T21:53:15.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:15.623938+0000 mon.smithi099 (mon.0) 195 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:15.950 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 2 2024-02-19T21:53:16.592 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-19T21:53:16.592 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph config generate-minimal-conf 2024-02-19T21:53:16.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:15.625663+0000 mgr.smithi099.zfglya (mgr.14180) 30 : cephadm [INF] Deploying daemon node-exporter.smithi138 on smithi138 2024-02-19T21:53:16.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:15.946650+0000 mon.smithi099 (mon.0) 196 : audit [DBG] from='client.? 172.21.15.138:0/559715965' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:53:16.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:16.573967+0000 mon.smithi099 (mon.0) 197 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-19T21:53:17.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:15.625663+0000 mgr.smithi099.zfglya (mgr.14180) 30 : cephadm [INF] Deploying daemon node-exporter.smithi138 on smithi138 2024-02-19T21:53:17.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:15.946650+0000 mon.smithi099 (mon.0) 196 : audit [DBG] from='client.? 172.21.15.138:0/559715965' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T21:53:17.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:16.573967+0000 mon.smithi099 (mon.0) 197 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-19T21:53:17.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:16.313533+0000 mgr.smithi099.zfglya (mgr.14180) 31 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:18.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:16.313533+0000 mgr.smithi099.zfglya (mgr.14180) 31 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:# minimal ceph.conf for d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:53:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-02-19T21:53:18.953 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = d4704266-cf70-11ee-95bb-87774f69a715 2024-02-19T21:53:18.953 INFO:teuthology.orchestra.run.smithi099.stdout: mon_host = [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-02-19T21:53:19.621 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-19T21:53:19.621 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:53:19.621 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.conf 2024-02-19T21:53:19.651 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:53:19.651 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:53:19.719 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-19T21:53:19.719 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.conf 2024-02-19T21:53:19.752 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-19T21:53:19.752 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-19T21:53:19.821 INFO:tasks.cephadm:Deploying OSDs... 2024-02-19T21:53:19.821 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:53:19.821 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-02-19T21:53:19.839 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-19T21:53:19.839 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-02-19T21:53:19.896 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-19T21:53:19.896 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:53:19.897 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 159697 Links: 1 2024-02-19T21:53:19.897 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:53:19.897 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:53:19.897 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-02-19 21:52:39.158371568 +0000 2024-02-19T21:53:19.897 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-02-19 21:43:54.359670284 +0000 2024-02-19T21:53:19.897 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-02-19 21:43:54.359670284 +0000 2024-02-19T21:53:19.897 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-02-19T21:53:19.897 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-19T21:53:19.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:18.313775+0000 mgr.smithi099.zfglya (mgr.14180) 32 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:19.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:18.954339+0000 mon.smithi099 (mon.0) 198 : audit [DBG] from='client.? 172.21.15.99:0/2824935366' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:19.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:19.453306+0000 mon.smithi099 (mon.0) 199 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:19.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:19.509982+0000 mon.smithi099 (mon.0) 200 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:19.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:19.511260+0000 mon.smithi099 (mon.0) 201 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:53:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-02-19T21:53:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-02-19T21:53:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000253224 s, 2.0 MB/s 2024-02-19T21:53:19.963 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-19T21:53:20.023 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-02-19T21:53:20.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:18.313775+0000 mgr.smithi099.zfglya (mgr.14180) 32 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:20.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:18.954339+0000 mon.smithi099 (mon.0) 198 : audit [DBG] from='client.? 172.21.15.99:0/2824935366' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:20.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:19.453306+0000 mon.smithi099 (mon.0) 199 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:20.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:19.509982+0000 mon.smithi099 (mon.0) 200 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:20.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:19.511260+0000 mon.smithi099 (mon.0) 201 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:53:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-19T21:53:20.080 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:53:20.080 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 168964 Links: 1 2024-02-19T21:53:20.080 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:53:20.080 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:53:20.080 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-02-19 21:52:39.158371568 +0000 2024-02-19T21:53:20.081 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-02-19 21:43:54.704662119 +0000 2024-02-19T21:53:20.081 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-02-19 21:43:54.704662119 +0000 2024-02-19T21:53:20.081 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-02-19T21:53:20.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-19T21:53:20.145 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-02-19T21:53:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-02-19T21:53:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.00019548 s, 2.6 MB/s 2024-02-19T21:53:20.147 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-19T21:53:20.205 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-02-19T21:53:20.262 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-19T21:53:20.262 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:53:20.262 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 169038 Links: 1 2024-02-19T21:53:20.262 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:53:20.262 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:53:20.262 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-02-19 21:52:39.158371568 +0000 2024-02-19T21:53:20.262 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-02-19 21:43:55.061653670 +0000 2024-02-19T21:53:20.263 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-02-19 21:43:55.061653670 +0000 2024-02-19T21:53:20.263 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-02-19T21:53:20.263 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-19T21:53:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-02-19T21:53:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-02-19T21:53:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000182982 s, 2.8 MB/s 2024-02-19T21:53:20.329 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-19T21:53:20.388 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-02-19T21:53:20.445 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-19T21:53:20.446 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:53:20.446 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 170005 Links: 1 2024-02-19T21:53:20.446 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:53:20.446 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:53:20.446 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-02-19 21:52:39.158371568 +0000 2024-02-19T21:53:20.446 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-02-19 21:43:55.399645671 +0000 2024-02-19T21:53:20.446 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-02-19 21:43:55.399645671 +0000 2024-02-19T21:53:20.446 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-02-19T21:53:20.446 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-19T21:53:20.511 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-02-19T21:53:20.511 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-02-19T21:53:20.511 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000227552 s, 2.3 MB/s 2024-02-19T21:53:20.512 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-19T21:53:20.571 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-19T21:53:20.572 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-02-19T21:53:20.590 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-19T21:53:20.590 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-02-19T21:53:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-19T21:53:20.648 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:53:20.648 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 164843 Links: 1 2024-02-19T21:53:20.649 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:53:20.649 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:53:20.649 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-19 21:53:16.123845060 +0000 2024-02-19T21:53:20.649 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-19 21:43:55.433906336 +0000 2024-02-19T21:53:20.649 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-19 21:43:55.433906336 +0000 2024-02-19T21:53:20.649 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-02-19T21:53:20.649 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-19T21:53:20.715 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-19T21:53:20.716 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-19T21:53:20.716 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000287285 s, 1.8 MB/s 2024-02-19T21:53:20.717 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-19T21:53:20.776 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-02-19T21:53:20.833 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-19T21:53:20.833 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:53:20.833 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 165838 Links: 1 2024-02-19T21:53:20.833 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:53:20.833 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:53:20.833 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-19 21:53:16.123845060 +0000 2024-02-19T21:53:20.833 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-19 21:43:55.771899077 +0000 2024-02-19T21:53:20.833 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-19 21:43:55.771899077 +0000 2024-02-19T21:53:20.834 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-02-19T21:53:20.834 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-19T21:53:20.899 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-19T21:53:20.899 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-19T21:53:20.899 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000217316 s, 2.4 MB/s 2024-02-19T21:53:20.900 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-19T21:53:20.959 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-02-19T21:53:21.018 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-19T21:53:21.018 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:53:21.018 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 169152 Links: 1 2024-02-19T21:53:21.018 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:53:21.018 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:53:21.018 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-19 21:53:16.123845060 +0000 2024-02-19T21:53:21.018 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-19 21:43:56.117891646 +0000 2024-02-19T21:53:21.018 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-19 21:43:56.117891646 +0000 2024-02-19T21:53:21.018 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-02-19T21:53:21.019 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-19T21:53:21.084 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-19T21:53:21.084 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-19T21:53:21.084 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000162377 s, 3.2 MB/s 2024-02-19T21:53:21.085 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-19T21:53:21.144 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-02-19T21:53:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-19T21:53:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T21:53:21.202 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 160672 Links: 1 2024-02-19T21:53:21.202 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:53:21.202 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T21:53:21.202 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-19 21:53:16.124845038 +0000 2024-02-19T21:53:21.202 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-19 21:43:56.458884323 +0000 2024-02-19T21:53:21.202 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-19 21:43:56.458884323 +0000 2024-02-19T21:53:21.202 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-02-19T21:53:21.202 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-19T21:53:21.267 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-19T21:53:21.267 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-19T21:53:21.267 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000203564 s, 2.5 MB/s 2024-02-19T21:53:21.268 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-19T21:53:21.326 INFO:tasks.cephadm:Deploying osd.0 on smithi099 with /dev/vg_nvme/lv_4... 2024-02-19T21:53:21.327 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-19T21:53:21.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:20.314000+0000 mgr.smithi099.zfglya (mgr.14180) 33 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:21.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:21.452950+0000 mon.smithi099 (mon.0) 202 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:21.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:21.453627+0000 mon.smithi099 (mon.0) 203 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:21.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:21.454186+0000 mon.smithi099 (mon.0) 204 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:53:21.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:21.478513+0000 mon.smithi099 (mon.0) 205 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:21.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:21.483970+0000 mon.smithi099 (mon.0) 206 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:21.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:21.489244+0000 mon.smithi099 (mon.0) 207 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:21.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:21.492341+0000 mon.smithi099 (mon.0) 208 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:53:21.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:21.492858+0000 mon.smithi099 (mon.0) 209 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T21:53:21.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:21.493338+0000 mon.smithi099 (mon.0) 210 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:22.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:20.314000+0000 mgr.smithi099.zfglya (mgr.14180) 33 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:22.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:21.452950+0000 mon.smithi099 (mon.0) 202 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:22.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:21.453627+0000 mon.smithi099 (mon.0) 203 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:22.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:21.454186+0000 mon.smithi099 (mon.0) 204 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:53:22.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:21.478513+0000 mon.smithi099 (mon.0) 205 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:22.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:21.483970+0000 mon.smithi099 (mon.0) 206 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:22.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:21.489244+0000 mon.smithi099 (mon.0) 207 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:22.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:21.492341+0000 mon.smithi099 (mon.0) 208 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:53:22.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:21.492858+0000 mon.smithi099 (mon.0) 209 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T21:53:22.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:21.493338+0000 mon.smithi099 (mon.0) 210 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:22.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:21.455044+0000 mgr.smithi099.zfglya (mgr.14180) 34 : cephadm [INF] Updating smithi099:/etc/ceph/ceph.conf 2024-02-19T21:53:22.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:21.455296+0000 mgr.smithi099.zfglya (mgr.14180) 35 : cephadm [INF] Updating smithi138:/etc/ceph/ceph.conf 2024-02-19T21:53:22.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:21.492105+0000 mgr.smithi099.zfglya (mgr.14180) 36 : cephadm [INF] Reconfiguring mon.smithi099 (unknown last config time)... 2024-02-19T21:53:22.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:21.493792+0000 mgr.smithi099.zfglya (mgr.14180) 37 : cephadm [INF] Reconfiguring daemon mon.smithi099 on smithi099 2024-02-19T21:53:23.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:21.455044+0000 mgr.smithi099.zfglya (mgr.14180) 34 : cephadm [INF] Updating smithi099:/etc/ceph/ceph.conf 2024-02-19T21:53:23.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:21.455296+0000 mgr.smithi099.zfglya (mgr.14180) 35 : cephadm [INF] Updating smithi138:/etc/ceph/ceph.conf 2024-02-19T21:53:23.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:21.492105+0000 mgr.smithi099.zfglya (mgr.14180) 36 : cephadm [INF] Reconfiguring mon.smithi099 (unknown last config time)... 2024-02-19T21:53:23.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:21.493792+0000 mgr.smithi099.zfglya (mgr.14180) 37 : cephadm [INF] Reconfiguring daemon mon.smithi099 on smithi099 2024-02-19T21:53:23.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:22.314248+0000 mgr.smithi099.zfglya (mgr.14180) 38 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:23.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:23.537094+0000 mon.smithi099 (mon.0) 211 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:23.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:23.538380+0000 mon.smithi099 (mon.0) 212 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.zfglya", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T21:53:23.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:23.539134+0000 mon.smithi099 (mon.0) 213 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T21:53:23.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:23.539729+0000 mon.smithi099 (mon.0) 214 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:24.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:22.314248+0000 mgr.smithi099.zfglya (mgr.14180) 38 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:24.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:23.537094+0000 mon.smithi099 (mon.0) 211 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:24.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:23.538380+0000 mon.smithi099 (mon.0) 212 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.zfglya", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T21:53:24.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:23.539134+0000 mon.smithi099 (mon.0) 213 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T21:53:24.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:23.539729+0000 mon.smithi099 (mon.0) 214 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:24.490 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-19T21:53:24.490 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-19T21:53:24.490 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-02-19T21:53:24.490 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-02-19T21:53:24.491 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0201206 s, 521 MB/s 2024-02-19T21:53:24.491 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-02-19T21:53:25.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:23.538065+0000 mgr.smithi099.zfglya (mgr.14180) 39 : cephadm [INF] Reconfiguring mgr.smithi099.zfglya (unknown last config time)... 2024-02-19T21:53:25.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:23.540329+0000 mgr.smithi099.zfglya (mgr.14180) 40 : cephadm [INF] Reconfiguring daemon mgr.smithi099.zfglya on smithi099 2024-02-19T21:53:25.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:24.457494+0000 mon.smithi099 (mon.0) 215 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:25.117 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:23.538065+0000 mgr.smithi099.zfglya (mgr.14180) 39 : cephadm [INF] Reconfiguring mgr.smithi099.zfglya (unknown last config time)... 2024-02-19T21:53:25.118 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:23.540329+0000 mgr.smithi099.zfglya (mgr.14180) 40 : cephadm [INF] Reconfiguring daemon mgr.smithi099.zfglya on smithi099 2024-02-19T21:53:25.118 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:24.457494+0000 mon.smithi099 (mon.0) 215 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:25.581 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi099:vg_nvme/lv_4 2024-02-19T21:53:25.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:24.314458+0000 mgr.smithi099.zfglya (mgr.14180) 41 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:25.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:25.181411+0000 mon.smithi099 (mon.0) 216 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:26.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:24.314458+0000 mgr.smithi099.zfglya (mgr.14180) 41 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:26.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:25.181411+0000 mon.smithi099 (mon.0) 216 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:27.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:25.182040+0000 mgr.smithi099.zfglya (mgr.14180) 42 : cephadm [INF] Reconfiguring alertmanager.smithi099 (dependencies changed)... 2024-02-19T21:53:27.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:25.187997+0000 mgr.smithi099.zfglya (mgr.14180) 43 : cephadm [INF] Reconfiguring daemon alertmanager.smithi099 on smithi099 2024-02-19T21:53:27.135 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:25.182040+0000 mgr.smithi099.zfglya (mgr.14180) 42 : cephadm [INF] Reconfiguring alertmanager.smithi099 (dependencies changed)... 2024-02-19T21:53:27.135 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:25.187997+0000 mgr.smithi099.zfglya (mgr.14180) 43 : cephadm [INF] Reconfiguring daemon alertmanager.smithi099 on smithi099 2024-02-19T21:53:28.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:26.314709+0000 mgr.smithi099.zfglya (mgr.14180) 44 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:28.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:26.314709+0000 mgr.smithi099.zfglya (mgr.14180) 44 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:29.028 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:28.181169+0000 mon.smithi099 (mon.0) 217 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:53:29.028 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:28.183017+0000 mon.smithi099 (mon.0) 218 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:53:29.028 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:28.183531+0000 mon.smithi099 (mon.0) 219 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:29.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:28.181169+0000 mon.smithi099 (mon.0) 217 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:53:29.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:28.183017+0000 mon.smithi099 (mon.0) 218 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:53:29.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:28.183531+0000 mon.smithi099 (mon.0) 219 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:30.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:28.178662+0000 mgr.smithi099.zfglya (mgr.14180) 45 : audit [DBG] from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:53:30.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:28.314955+0000 mgr.smithi099.zfglya (mgr.14180) 46 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:30.068 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:28.178662+0000 mgr.smithi099.zfglya (mgr.14180) 45 : audit [DBG] from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:53:30.068 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:28.314955+0000 mgr.smithi099.zfglya (mgr.14180) 46 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:32.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:30.315197+0000 mgr.smithi099.zfglya (mgr.14180) 47 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:32.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:30.315197+0000 mgr.smithi099.zfglya (mgr.14180) 47 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:34.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:32.315419+0000 mgr.smithi099.zfglya (mgr.14180) 48 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:34.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:32.818208+0000 mon.smithi099 (mon.0) 220 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:34.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:32.818693+0000 mgr.smithi099.zfglya (mgr.14180) 49 : cephadm [INF] Reconfiguring crash.smithi099 (monmap changed)... 2024-02-19T21:53:34.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:32.818924+0000 mon.smithi099 (mon.0) 221 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T21:53:34.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:32.819554+0000 mon.smithi099 (mon.0) 222 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:34.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:32.820001+0000 mgr.smithi099.zfglya (mgr.14180) 50 : cephadm [INF] Reconfiguring daemon crash.smithi099 on smithi099 2024-02-19T21:53:34.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:32.315419+0000 mgr.smithi099.zfglya (mgr.14180) 48 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:34.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:32.818208+0000 mon.smithi099 (mon.0) 220 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:34.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:32.818693+0000 mgr.smithi099.zfglya (mgr.14180) 49 : cephadm [INF] Reconfiguring crash.smithi099 (monmap changed)... 2024-02-19T21:53:34.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:32.818924+0000 mon.smithi099 (mon.0) 221 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T21:53:34.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:32.819554+0000 mon.smithi099 (mon.0) 222 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:34.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:32.820001+0000 mgr.smithi099.zfglya (mgr.14180) 50 : cephadm [INF] Reconfiguring daemon crash.smithi099 on smithi099 2024-02-19T21:53:35.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:33.882137+0000 mon.smithi099 (mon.0) 223 : audit [INF] from='client.? 172.21.15.99:0/3688115237' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e53b344b-7e5c-40ce-a9fb-75cabf0a2e38"}]: dispatch 2024-02-19T21:53:35.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:33.888249+0000 mon.smithi099 (mon.0) 224 : audit [INF] from='client.? 172.21.15.99:0/3688115237' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e53b344b-7e5c-40ce-a9fb-75cabf0a2e38"}]': finished 2024-02-19T21:53:35.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:33.888287+0000 mon.smithi099 (mon.0) 225 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-19T21:53:35.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:33.888375+0000 mon.smithi099 (mon.0) 226 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:53:35.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:34.446626+0000 mon.smithi099 (mon.0) 227 : audit [DBG] from='client.? 172.21.15.99:0/3088364468' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:53:35.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:33.882137+0000 mon.smithi099 (mon.0) 223 : audit [INF] from='client.? 172.21.15.99:0/3688115237' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e53b344b-7e5c-40ce-a9fb-75cabf0a2e38"}]: dispatch 2024-02-19T21:53:35.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:33.888249+0000 mon.smithi099 (mon.0) 224 : audit [INF] from='client.? 172.21.15.99:0/3688115237' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e53b344b-7e5c-40ce-a9fb-75cabf0a2e38"}]': finished 2024-02-19T21:53:35.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:33.888287+0000 mon.smithi099 (mon.0) 225 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-19T21:53:35.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:33.888375+0000 mon.smithi099 (mon.0) 226 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:53:35.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:34.446626+0000 mon.smithi099 (mon.0) 227 : audit [DBG] from='client.? 172.21.15.99:0/3088364468' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:53:36.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:34.315647+0000 mgr.smithi099.zfglya (mgr.14180) 51 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:36.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:34.315647+0000 mgr.smithi099.zfglya (mgr.14180) 51 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:38.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:36.315841+0000 mgr.smithi099.zfglya (mgr.14180) 52 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:38.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:36.315841+0000 mgr.smithi099.zfglya (mgr.14180) 52 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:39.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:38.316064+0000 mgr.smithi099.zfglya (mgr.14180) 53 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:39.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:38.454751+0000 mon.smithi099 (mon.0) 228 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:39.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:38.455296+0000 mgr.smithi099.zfglya (mgr.14180) 54 : cephadm [INF] Reconfiguring grafana.smithi099 (dependencies changed)... 2024-02-19T21:53:39.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:38.488900+0000 mgr.smithi099.zfglya (mgr.14180) 55 : cephadm [INF] Reconfiguring daemon grafana.smithi099 on smithi099 2024-02-19T21:53:39.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:38.316064+0000 mgr.smithi099.zfglya (mgr.14180) 53 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:39.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:38.454751+0000 mon.smithi099 (mon.0) 228 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:39.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:38.455296+0000 mgr.smithi099.zfglya (mgr.14180) 54 : cephadm [INF] Reconfiguring grafana.smithi099 (dependencies changed)... 2024-02-19T21:53:39.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:38.488900+0000 mgr.smithi099.zfglya (mgr.14180) 55 : cephadm [INF] Reconfiguring daemon grafana.smithi099 on smithi099 2024-02-19T21:53:41.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:40.316346+0000 mgr.smithi099.zfglya (mgr.14180) 56 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:41.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:40.316346+0000 mgr.smithi099.zfglya (mgr.14180) 56 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:43.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:42.316642+0000 mgr.smithi099.zfglya (mgr.14180) 57 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:43.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:42.316642+0000 mgr.smithi099.zfglya (mgr.14180) 57 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:44.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:43.567847+0000 mon.smithi099 (mon.0) 229 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:44.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:43.568574+0000 mgr.smithi099.zfglya (mgr.14180) 58 : cephadm [INF] Reconfiguring prometheus.smithi099 (dependencies changed)... 2024-02-19T21:53:44.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:43.572027+0000 mgr.smithi099.zfglya (mgr.14180) 59 : cephadm [INF] Reconfiguring daemon prometheus.smithi099 on smithi099 2024-02-19T21:53:45.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:43.567847+0000 mon.smithi099 (mon.0) 229 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:45.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:43.568574+0000 mgr.smithi099.zfglya (mgr.14180) 58 : cephadm [INF] Reconfiguring prometheus.smithi099 (dependencies changed)... 2024-02-19T21:53:45.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:43.572027+0000 mgr.smithi099.zfglya (mgr.14180) 59 : cephadm [INF] Reconfiguring daemon prometheus.smithi099 on smithi099 2024-02-19T21:53:45.818 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:44.316901+0000 mgr.smithi099.zfglya (mgr.14180) 60 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:45.818 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:45.120546+0000 mon.smithi099 (mon.0) 230 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T21:53:45.819 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:45.121176+0000 mon.smithi099 (mon.0) 231 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:46.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:44.316901+0000 mgr.smithi099.zfglya (mgr.14180) 60 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:46.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:45.120546+0000 mon.smithi099 (mon.0) 230 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T21:53:46.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:45.121176+0000 mon.smithi099 (mon.0) 231 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:46.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:45.121690+0000 mgr.smithi099.zfglya (mgr.14180) 61 : cephadm [INF] Deploying daemon osd.0 on smithi099 2024-02-19T21:53:47.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:45.121690+0000 mgr.smithi099.zfglya (mgr.14180) 61 : cephadm [INF] Deploying daemon osd.0 on smithi099 2024-02-19T21:53:47.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:46.317241+0000 mgr.smithi099.zfglya (mgr.14180) 62 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:48.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:46.317241+0000 mgr.smithi099.zfglya (mgr.14180) 62 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:49.890 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:48.317589+0000 mgr.smithi099.zfglya (mgr.14180) 63 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:50.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:48.317589+0000 mgr.smithi099.zfglya (mgr.14180) 63 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:51.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:50.174908+0000 mon.smithi099 (mon.0) 232 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:51.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:50.175454+0000 mgr.smithi099.zfglya (mgr.14180) 64 : cephadm [INF] Reconfiguring crash.smithi138 (monmap changed)... 2024-02-19T21:53:51.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:50.175672+0000 mon.smithi099 (mon.0) 233 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T21:53:51.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:50.176251+0000 mon.smithi099 (mon.0) 234 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:51.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:50.176724+0000 mgr.smithi099.zfglya (mgr.14180) 65 : cephadm [INF] Reconfiguring daemon crash.smithi138 on smithi138 2024-02-19T21:53:51.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:50.317836+0000 mgr.smithi099.zfglya (mgr.14180) 66 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:51.305 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:50.174908+0000 mon.smithi099 (mon.0) 232 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:51.305 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:50.175454+0000 mgr.smithi099.zfglya (mgr.14180) 64 : cephadm [INF] Reconfiguring crash.smithi138 (monmap changed)... 2024-02-19T21:53:51.305 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:50.175672+0000 mon.smithi099 (mon.0) 233 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T21:53:51.305 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:50.176251+0000 mon.smithi099 (mon.0) 234 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:51.305 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:50.176724+0000 mgr.smithi099.zfglya (mgr.14180) 65 : cephadm [INF] Reconfiguring daemon crash.smithi138 on smithi138 2024-02-19T21:53:51.305 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:50.317836+0000 mgr.smithi099.zfglya (mgr.14180) 66 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:52.887 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:51.762752+0000 mon.smithi099 (mon.0) 235 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:52.887 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:51.763256+0000 mgr.smithi099.zfglya (mgr.14180) 67 : cephadm [INF] Reconfiguring mgr.smithi138.yvypfr (monmap changed)... 2024-02-19T21:53:52.887 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:51.763575+0000 mon.smithi099 (mon.0) 236 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.yvypfr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T21:53:52.887 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:51.764359+0000 mon.smithi099 (mon.0) 237 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T21:53:52.887 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:51.764949+0000 mon.smithi099 (mon.0) 238 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:52.887 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:51.765477+0000 mgr.smithi099.zfglya (mgr.14180) 68 : cephadm [INF] Reconfiguring daemon mgr.smithi138.yvypfr on smithi138 2024-02-19T21:53:53.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:51.762752+0000 mon.smithi099 (mon.0) 235 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:53.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:51.763256+0000 mgr.smithi099.zfglya (mgr.14180) 67 : cephadm [INF] Reconfiguring mgr.smithi138.yvypfr (monmap changed)... 2024-02-19T21:53:53.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:51.763575+0000 mon.smithi099 (mon.0) 236 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.yvypfr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T21:53:53.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:51.764359+0000 mon.smithi099 (mon.0) 237 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T21:53:53.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:51.764949+0000 mon.smithi099 (mon.0) 238 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:53.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:51.765477+0000 mgr.smithi099.zfglya (mgr.14180) 68 : cephadm [INF] Reconfiguring daemon mgr.smithi138.yvypfr on smithi138 2024-02-19T21:53:53.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:52.318074+0000 mgr.smithi099.zfglya (mgr.14180) 69 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:53.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:53.588250+0000 mon.smithi099 (mon.0) 239 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:53.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:53.589008+0000 mon.smithi099 (mon.0) 240 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:53:53.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:53.589560+0000 mon.smithi099 (mon.0) 241 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T21:53:53.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:53.590045+0000 mon.smithi099 (mon.0) 242 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:54.097 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:52.318074+0000 mgr.smithi099.zfglya (mgr.14180) 69 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:54.097 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:53.588250+0000 mon.smithi099 (mon.0) 239 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:54.097 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:53.589008+0000 mon.smithi099 (mon.0) 240 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T21:53:54.098 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:53.589560+0000 mon.smithi099 (mon.0) 241 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T21:53:54.098 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:53.590045+0000 mon.smithi099 (mon.0) 242 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:53:55.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:53.588801+0000 mgr.smithi099.zfglya (mgr.14180) 70 : cephadm [INF] Reconfiguring mon.smithi138 (monmap changed)... 2024-02-19T21:53:55.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:53:53.590525+0000 mgr.smithi099.zfglya (mgr.14180) 71 : cephadm [INF] Reconfiguring daemon mon.smithi138 on smithi138 2024-02-19T21:53:55.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:53.588801+0000 mgr.smithi099.zfglya (mgr.14180) 70 : cephadm [INF] Reconfiguring mon.smithi138 (monmap changed)... 2024-02-19T21:53:55.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:53:53.590525+0000 mgr.smithi099.zfglya (mgr.14180) 71 : cephadm [INF] Reconfiguring daemon mon.smithi138 on smithi138 2024-02-19T21:53:56.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:54.318435+0000 mgr.smithi099.zfglya (mgr.14180) 72 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:56.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.012558+0000 mon.smithi099 (mon.0) 243 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:56.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.165659+0000 mon.smithi099 (mon.0) 244 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:56.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.168304+0000 mon.smithi099 (mon.0) 245 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T21:53:56.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.169380+0000 mon.smithi099 (mon.0) 246 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi099.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T21:53:56.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.173033+0000 mon.smithi099 (mon.0) 247 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:56.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.176541+0000 mon.smithi099 (mon.0) 248 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T21:53:56.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.181490+0000 mon.smithi099 (mon.0) 249 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T21:53:56.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.185552+0000 mon.smithi099 (mon.0) 250 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:56.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.191164+0000 mon.smithi099 (mon.0) 251 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T21:53:56.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.195062+0000 mon.smithi099 (mon.0) 252 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T21:53:56.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.199798+0000 mon.smithi099 (mon.0) 253 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:56.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.203278+0000 mon.smithi099 (mon.0) 254 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:53:56.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:54.318435+0000 mgr.smithi099.zfglya (mgr.14180) 72 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:56.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.012558+0000 mon.smithi099 (mon.0) 243 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:56.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.165659+0000 mon.smithi099 (mon.0) 244 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:56.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.168304+0000 mon.smithi099 (mon.0) 245 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T21:53:56.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.169380+0000 mon.smithi099 (mon.0) 246 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi099.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T21:53:56.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.173033+0000 mon.smithi099 (mon.0) 247 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:56.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.176541+0000 mon.smithi099 (mon.0) 248 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T21:53:56.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.181490+0000 mon.smithi099 (mon.0) 249 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T21:53:56.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.185552+0000 mon.smithi099 (mon.0) 250 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:56.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.191164+0000 mon.smithi099 (mon.0) 251 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T21:53:56.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.195062+0000 mon.smithi099 (mon.0) 252 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T21:53:56.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.199798+0000 mon.smithi099 (mon.0) 253 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:56.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.203278+0000 mon.smithi099 (mon.0) 254 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:53:57.152 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.168618+0000 mgr.smithi099.zfglya (mgr.14180) 73 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T21:53:57.152 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.169612+0000 mgr.smithi099.zfglya (mgr.14180) 74 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi099.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T21:53:57.152 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.176885+0000 mgr.smithi099.zfglya (mgr.14180) 75 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T21:53:57.152 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.181831+0000 mgr.smithi099.zfglya (mgr.14180) 76 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T21:53:57.152 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.191557+0000 mgr.smithi099.zfglya (mgr.14180) 77 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T21:53:57.152 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:55.195438+0000 mgr.smithi099.zfglya (mgr.14180) 78 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T21:53:57.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.168618+0000 mgr.smithi099.zfglya (mgr.14180) 73 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T21:53:57.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.169612+0000 mgr.smithi099.zfglya (mgr.14180) 74 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi099.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T21:53:57.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.176885+0000 mgr.smithi099.zfglya (mgr.14180) 75 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T21:53:57.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.181831+0000 mgr.smithi099.zfglya (mgr.14180) 76 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T21:53:57.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.191557+0000 mgr.smithi099.zfglya (mgr.14180) 77 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T21:53:57.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:55.195438+0000 mgr.smithi099.zfglya (mgr.14180) 78 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T21:53:58.031 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 0 on host 'smithi099' 2024-02-19T21:53:58.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:56.318802+0000 mgr.smithi099.zfglya (mgr.14180) 79 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:58.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:57.173961+0000 mon.smithi099 (mon.0) 255 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:58.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:56.318802+0000 mgr.smithi099.zfglya (mgr.14180) 79 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:53:58.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:57.173961+0000 mon.smithi099 (mon.0) 255 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:58.854 DEBUG:teuthology.orchestra.run.smithi099:osd.0> sudo journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.0.service 2024-02-19T21:53:58.857 INFO:tasks.cephadm:Deploying osd.1 on smithi099 with /dev/vg_nvme/lv_3... 2024-02-19T21:53:58.857 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-19T21:53:58.885 INFO:journalctl@ceph.osd.0.smithi099.stdout:-- Logs begin at Mon 2024-02-19 21:38:19 UTC. -- 2024-02-19T21:53:59.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:58.030834+0000 mon.smithi099 (mon.0) 256 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:59.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:53:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:58.125282+0000 mon.smithi099 (mon.0) 257 : audit [INF] from='osd.0 [v2:172.21.15.99:6802/3368424446,v1:172.21.15.99:6803/3368424446]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T21:53:59.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:58.030834+0000 mon.smithi099 (mon.0) 256 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:53:59.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:53:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:58.125282+0000 mon.smithi099 (mon.0) 257 : audit [INF] from='osd.0 [v2:172.21.15.99:6802/3368424446,v1:172.21.15.99:6803/3368424446]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T21:54:00.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:58.319371+0000 mgr.smithi099.zfglya (mgr.14180) 80 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:54:00.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:59.035776+0000 mon.smithi099 (mon.0) 258 : audit [INF] from='osd.0 [v2:172.21.15.99:6802/3368424446,v1:172.21.15.99:6803/3368424446]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T21:54:00.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:59.035821+0000 mon.smithi099 (mon.0) 259 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-19T21:54:00.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:59.036006+0000 mon.smithi099 (mon.0) 260 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:54:00.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:53:59.036343+0000 mon.smithi099 (mon.0) 261 : audit [INF] from='osd.0 [v2:172.21.15.99:6802/3368424446,v1:172.21.15.99:6803/3368424446]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-02-19T21:54:00.391 INFO:journalctl@ceph.osd.0.smithi099.stdout:Feb 19 21:54:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-0[51454]: debug 2024-02-19T21:54:00.040+0000 7f93f13c6700 -1 osd.0 0 waiting for initial osdmap 2024-02-19T21:54:00.391 INFO:journalctl@ceph.osd.0.smithi099.stdout:Feb 19 21:54:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-0[51454]: debug 2024-02-19T21:54:00.043+0000 7f93ea33b700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:54:00.392 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:58.319371+0000 mgr.smithi099.zfglya (mgr.14180) 80 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:54:00.392 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:59.035776+0000 mon.smithi099 (mon.0) 258 : audit [INF] from='osd.0 [v2:172.21.15.99:6802/3368424446,v1:172.21.15.99:6803/3368424446]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T21:54:00.392 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:59.035821+0000 mon.smithi099 (mon.0) 259 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-19T21:54:00.392 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:59.036006+0000 mon.smithi099 (mon.0) 260 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:54:00.392 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:53:59.036343+0000 mon.smithi099 (mon.0) 261 : audit [INF] from='osd.0 [v2:172.21.15.99:6802/3368424446,v1:172.21.15.99:6803/3368424446]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-02-19T21:54:01.401 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:00.037789+0000 mon.smithi099 (mon.0) 262 : audit [INF] from='osd.0 [v2:172.21.15.99:6802/3368424446,v1:172.21.15.99:6803/3368424446]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-02-19T21:54:01.402 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:00.037865+0000 mon.smithi099 (mon.0) 263 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2024-02-19T21:54:01.402 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:00.038205+0000 mon.smithi099 (mon.0) 264 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:54:01.402 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:00.042108+0000 mon.smithi099 (mon.0) 265 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:54:01.458 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-19T21:54:01.458 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-19T21:54:01.459 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-02-19T21:54:01.459 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-02-19T21:54:01.459 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119816 s, 875 MB/s 2024-02-19T21:54:01.459 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-02-19T21:54:01.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:00.037789+0000 mon.smithi099 (mon.0) 262 : audit [INF] from='osd.0 [v2:172.21.15.99:6802/3368424446,v1:172.21.15.99:6803/3368424446]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-02-19T21:54:01.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:00.037865+0000 mon.smithi099 (mon.0) 263 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2024-02-19T21:54:01.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:00.038205+0000 mon.smithi099 (mon.0) 264 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:54:01.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:00.042108+0000 mon.smithi099 (mon.0) 265 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:54:02.336 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:59.171135+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:02.337 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:53:59.171254+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:02.337 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:00.319626+0000 mgr.smithi099.zfglya (mgr.14180) 81 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:54:02.337 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:01.042750+0000 mon.smithi099 (mon.0) 266 : cluster [INF] osd.0 [v2:172.21.15.99:6802/3368424446,v1:172.21.15.99:6803/3368424446] boot 2024-02-19T21:54:02.337 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:01.042776+0000 mon.smithi099 (mon.0) 267 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-19T21:54:02.337 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:01.043239+0000 mon.smithi099 (mon.0) 268 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:54:02.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:59.171135+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:02.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:53:59.171254+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:02.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:00.319626+0000 mgr.smithi099.zfglya (mgr.14180) 81 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T21:54:02.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:01.042750+0000 mon.smithi099 (mon.0) 266 : cluster [INF] osd.0 [v2:172.21.15.99:6802/3368424446,v1:172.21.15.99:6803/3368424446] boot 2024-02-19T21:54:02.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:01.042776+0000 mon.smithi099 (mon.0) 267 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-19T21:54:02.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:01.043239+0000 mon.smithi099 (mon.0) 268 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T21:54:02.780 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi099:vg_nvme/lv_3 2024-02-19T21:54:03.348 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:02.053965+0000 mon.smithi099 (mon.0) 269 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-19T21:54:03.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:02.053965+0000 mon.smithi099 (mon.0) 269 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-19T21:54:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:02.319998+0000 mgr.smithi099.zfglya (mgr.14180) 82 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:04.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:02.319998+0000 mgr.smithi099.zfglya (mgr.14180) 82 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:06.408 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:04.320276+0000 mgr.smithi099.zfglya (mgr.14180) 83 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:06.408 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:05.276994+0000 mon.smithi099 (mon.0) 270 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:06.409 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:05.389047+0000 mon.smithi099 (mon.0) 271 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:54:06.409 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:05.390941+0000 mon.smithi099 (mon.0) 272 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:54:06.409 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:05.391546+0000 mon.smithi099 (mon.0) 273 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:06.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:04.320276+0000 mgr.smithi099.zfglya (mgr.14180) 83 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:06.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:05.276994+0000 mon.smithi099 (mon.0) 270 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:06.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:05.389047+0000 mon.smithi099 (mon.0) 271 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:54:06.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:05.390941+0000 mon.smithi099 (mon.0) 272 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:54:06.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:05.391546+0000 mon.smithi099 (mon.0) 273 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:07.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:05.386887+0000 mgr.smithi099.zfglya (mgr.14180) 84 : audit [DBG] from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:54:07.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:05.386887+0000 mgr.smithi099.zfglya (mgr.14180) 84 : audit [DBG] from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:54:08.401 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:06.320562+0000 mgr.smithi099.zfglya (mgr.14180) 85 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:08.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:06.320562+0000 mgr.smithi099.zfglya (mgr.14180) 85 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:10.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:08.320865+0000 mgr.smithi099.zfglya (mgr.14180) 86 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:10.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:54:08.871978+0000 mgr.smithi099.zfglya (mgr.14180) 87 : cephadm [INF] Detected new or changed devices on smithi099 2024-02-19T21:54:10.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:08.876468+0000 mon.smithi099 (mon.0) 274 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:10.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:09.158546+0000 mon.smithi099 (mon.0) 275 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:54:10.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:09.164851+0000 mon.smithi099 (mon.0) 276 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:10.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:09.165508+0000 mon.smithi099 (mon.0) 277 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:10.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:09.166000+0000 mon.smithi099 (mon.0) 278 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:54:10.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:09.171543+0000 mon.smithi099 (mon.0) 279 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:10.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:09.174797+0000 mon.smithi099 (mon.0) 280 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:54:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:08.320865+0000 mgr.smithi099.zfglya (mgr.14180) 86 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:54:08.871978+0000 mgr.smithi099.zfglya (mgr.14180) 87 : cephadm [INF] Detected new or changed devices on smithi099 2024-02-19T21:54:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:08.876468+0000 mon.smithi099 (mon.0) 274 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:09.158546+0000 mon.smithi099 (mon.0) 275 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:54:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:09.164851+0000 mon.smithi099 (mon.0) 276 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:09.165508+0000 mon.smithi099 (mon.0) 277 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:09.166000+0000 mon.smithi099 (mon.0) 278 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:54:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:09.171543+0000 mon.smithi099 (mon.0) 279 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:10.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:09.174797+0000 mon.smithi099 (mon.0) 280 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:54:10.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:54:09.159094+0000 mgr.smithi099.zfglya (mgr.14180) 88 : cephadm [INF] Adjusting osd_memory_target on smithi099 to 12898M 2024-02-19T21:54:10.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:09.896989+0000 mon.smithi099 (mon.0) 281 : audit [INF] from='client.? 172.21.15.99:0/990319890' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee0c10da-32d9-4965-b77c-3af025167ce4"}]: dispatch 2024-02-19T21:54:10.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:09.900860+0000 mon.smithi099 (mon.0) 282 : audit [INF] from='client.? 172.21.15.99:0/990319890' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee0c10da-32d9-4965-b77c-3af025167ce4"}]': finished 2024-02-19T21:54:10.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:09.900895+0000 mon.smithi099 (mon.0) 283 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-19T21:54:10.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:09.901017+0000 mon.smithi099 (mon.0) 284 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:54:10.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:10.646856+0000 mon.smithi099 (mon.0) 285 : audit [DBG] from='client.? 172.21.15.99:0/580174412' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:54:11.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:54:09.159094+0000 mgr.smithi099.zfglya (mgr.14180) 88 : cephadm [INF] Adjusting osd_memory_target on smithi099 to 12898M 2024-02-19T21:54:11.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:09.896989+0000 mon.smithi099 (mon.0) 281 : audit [INF] from='client.? 172.21.15.99:0/990319890' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee0c10da-32d9-4965-b77c-3af025167ce4"}]: dispatch 2024-02-19T21:54:11.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:09.900860+0000 mon.smithi099 (mon.0) 282 : audit [INF] from='client.? 172.21.15.99:0/990319890' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee0c10da-32d9-4965-b77c-3af025167ce4"}]': finished 2024-02-19T21:54:11.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:09.900895+0000 mon.smithi099 (mon.0) 283 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-19T21:54:11.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:09.901017+0000 mon.smithi099 (mon.0) 284 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:54:11.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:10.646856+0000 mon.smithi099 (mon.0) 285 : audit [DBG] from='client.? 172.21.15.99:0/580174412' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:54:12.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:10.321118+0000 mgr.smithi099.zfglya (mgr.14180) 89 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:12.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:11.263000+0000 mon.smithi099 (mon.0) 286 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:12.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:10.321118+0000 mgr.smithi099.zfglya (mgr.14180) 89 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:12.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:11.263000+0000 mon.smithi099 (mon.0) 286 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:14.004 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:12.321377+0000 mgr.smithi099.zfglya (mgr.14180) 90 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:14.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:12.321377+0000 mgr.smithi099.zfglya (mgr.14180) 90 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:15.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:14.056336+0000 mon.smithi099 (mon.0) 287 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:15.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:14.057087+0000 mon.smithi099 (mon.0) 288 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:15.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:14.057713+0000 mon.smithi099 (mon.0) 289 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:54:15.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:14.063886+0000 mon.smithi099 (mon.0) 290 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:15.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:14.056336+0000 mon.smithi099 (mon.0) 287 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:15.502 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:14.057087+0000 mon.smithi099 (mon.0) 288 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:15.502 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:14.057713+0000 mon.smithi099 (mon.0) 289 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:54:15.502 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:14.063886+0000 mon.smithi099 (mon.0) 290 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:16.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:14.321696+0000 mgr.smithi099.zfglya (mgr.14180) 91 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:16.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:14.321696+0000 mgr.smithi099.zfglya (mgr.14180) 91 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:17.405 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:16.979545+0000 mon.smithi099 (mon.0) 291 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T21:54:17.405 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:16.980101+0000 mon.smithi099 (mon.0) 292 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:17.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:16.979545+0000 mon.smithi099 (mon.0) 291 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T21:54:17.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:16.980101+0000 mon.smithi099 (mon.0) 292 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:18.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:16.321975+0000 mgr.smithi099.zfglya (mgr.14180) 92 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:18.316 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:54:16.980566+0000 mgr.smithi099.zfglya (mgr.14180) 93 : cephadm [INF] Deploying daemon osd.1 on smithi099 2024-02-19T21:54:18.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:16.321975+0000 mgr.smithi099.zfglya (mgr.14180) 92 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:18.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:54:16.980566+0000 mgr.smithi099.zfglya (mgr.14180) 93 : cephadm [INF] Deploying daemon osd.1 on smithi099 2024-02-19T21:54:20.139 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:18.322270+0000 mgr.smithi099.zfglya (mgr.14180) 94 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:20.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:18.322270+0000 mgr.smithi099.zfglya (mgr.14180) 94 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:22.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:20.322621+0000 mgr.smithi099.zfglya (mgr.14180) 95 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:22.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:20.322621+0000 mgr.smithi099.zfglya (mgr.14180) 95 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:23.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:22.224312+0000 mon.smithi099 (mon.0) 293 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:23.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:22.248830+0000 mon.smithi099 (mon.0) 294 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:54:23.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:22.322903+0000 mgr.smithi099.zfglya (mgr.14180) 96 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:23.625 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:22.224312+0000 mon.smithi099 (mon.0) 293 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:23.625 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:22.248830+0000 mon.smithi099 (mon.0) 294 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:54:23.625 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:22.322903+0000 mgr.smithi099.zfglya (mgr.14180) 96 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:25.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:24.119230+0000 mon.smithi099 (mon.0) 295 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:25.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:24.323167+0000 mgr.smithi099.zfglya (mgr.14180) 97 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:25.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:24.119230+0000 mon.smithi099 (mon.0) 295 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:25.502 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:24.323167+0000 mgr.smithi099.zfglya (mgr.14180) 97 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:25.932 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 1 on host 'smithi099' 2024-02-19T21:54:26.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:25.336066+0000 mon.smithi099 (mon.0) 296 : audit [INF] from='osd.1 [v2:172.21.15.99:6810/1906568453,v1:172.21.15.99:6811/1906568453]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T21:54:26.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:25.932362+0000 mon.smithi099 (mon.0) 297 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:26.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:25.336066+0000 mon.smithi099 (mon.0) 296 : audit [INF] from='osd.1 [v2:172.21.15.99:6810/1906568453,v1:172.21.15.99:6811/1906568453]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T21:54:26.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:25.932362+0000 mon.smithi099 (mon.0) 297 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:26.872 DEBUG:teuthology.orchestra.run.smithi099:osd.1> sudo journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.1.service 2024-02-19T21:54:26.874 INFO:tasks.cephadm:Deploying osd.2 on smithi099 with /dev/vg_nvme/lv_2... 2024-02-19T21:54:26.874 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-19T21:54:26.904 INFO:journalctl@ceph.osd.1.smithi099.stdout:-- Logs begin at Mon 2024-02-19 21:38:19 UTC. -- 2024-02-19T21:54:27.442 INFO:journalctl@ceph.osd.1.smithi099.stdout:Feb 19 21:54:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-1[57013]: debug 2024-02-19T21:54:27.135+0000 7f1269ac1700 -1 osd.1 0 waiting for initial osdmap 2024-02-19T21:54:27.442 INFO:journalctl@ceph.osd.1.smithi099.stdout:Feb 19 21:54:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-1[57013]: debug 2024-02-19T21:54:27.139+0000 7f1264a3a700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:54:27.443 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:26.131941+0000 mon.smithi099 (mon.0) 298 : audit [INF] from='osd.1 [v2:172.21.15.99:6810/1906568453,v1:172.21.15.99:6811/1906568453]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-19T21:54:27.443 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:26.132001+0000 mon.smithi099 (mon.0) 299 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-19T21:54:27.443 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:26.132123+0000 mon.smithi099 (mon.0) 300 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:54:27.443 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:26.132445+0000 mon.smithi099 (mon.0) 301 : audit [INF] from='osd.1 [v2:172.21.15.99:6810/1906568453,v1:172.21.15.99:6811/1906568453]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-02-19T21:54:27.443 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:26.323644+0000 mgr.smithi099.zfglya (mgr.14180) 98 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:27.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:26.131941+0000 mon.smithi099 (mon.0) 298 : audit [INF] from='osd.1 [v2:172.21.15.99:6810/1906568453,v1:172.21.15.99:6811/1906568453]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-19T21:54:27.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:26.132001+0000 mon.smithi099 (mon.0) 299 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-19T21:54:27.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:26.132123+0000 mon.smithi099 (mon.0) 300 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:54:27.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:26.132445+0000 mon.smithi099 (mon.0) 301 : audit [INF] from='osd.1 [v2:172.21.15.99:6810/1906568453,v1:172.21.15.99:6811/1906568453]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-02-19T21:54:27.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:26.323644+0000 mgr.smithi099.zfglya (mgr.14180) 98 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:28.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:27.133457+0000 mon.smithi099 (mon.0) 302 : audit [INF] from='osd.1 [v2:172.21.15.99:6810/1906568453,v1:172.21.15.99:6811/1906568453]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-02-19T21:54:28.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:27.133503+0000 mon.smithi099 (mon.0) 303 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2024-02-19T21:54:28.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:27.133827+0000 mon.smithi099 (mon.0) 304 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:54:28.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:27.137965+0000 mon.smithi099 (mon.0) 305 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:54:28.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:27.133457+0000 mon.smithi099 (mon.0) 302 : audit [INF] from='osd.1 [v2:172.21.15.99:6810/1906568453,v1:172.21.15.99:6811/1906568453]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-02-19T21:54:28.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:27.133503+0000 mon.smithi099 (mon.0) 303 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2024-02-19T21:54:28.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:27.133827+0000 mon.smithi099 (mon.0) 304 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:54:28.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:27.137965+0000 mon.smithi099 (mon.0) 305 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:54:29.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:26.362382+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:29.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:26.362465+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:29.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:28.138022+0000 mon.smithi099 (mon.0) 306 : cluster [INF] osd.1 [v2:172.21.15.99:6810/1906568453,v1:172.21.15.99:6811/1906568453] boot 2024-02-19T21:54:29.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:28.138045+0000 mon.smithi099 (mon.0) 307 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-19T21:54:29.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:28.138332+0000 mon.smithi099 (mon.0) 308 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:54:29.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:28.323966+0000 mgr.smithi099.zfglya (mgr.14180) 99 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:29.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:26.362382+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:29.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:26.362465+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:29.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:28.138022+0000 mon.smithi099 (mon.0) 306 : cluster [INF] osd.1 [v2:172.21.15.99:6810/1906568453,v1:172.21.15.99:6811/1906568453] boot 2024-02-19T21:54:29.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:28.138045+0000 mon.smithi099 (mon.0) 307 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-19T21:54:29.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:28.138332+0000 mon.smithi099 (mon.0) 308 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T21:54:29.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:28.323966+0000 mgr.smithi099.zfglya (mgr.14180) 99 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-19T21:54:30.308 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-19T21:54:30.309 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-19T21:54:30.309 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-02-19T21:54:30.309 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-02-19T21:54:30.309 INFO:teuthology.orchestra.run.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0149819 s, 700 MB/s 2024-02-19T21:54:30.309 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-02-19T21:54:30.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:29.146194+0000 mon.smithi099 (mon.0) 309 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-02-19T21:54:30.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:30.010258+0000 mon.smithi099 (mon.0) 310 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:30.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:29.146194+0000 mon.smithi099 (mon.0) 309 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-02-19T21:54:30.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:30.010258+0000 mon.smithi099 (mon.0) 310 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:31.226 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:30.324256+0000 mgr.smithi099.zfglya (mgr.14180) 100 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:31.245 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi099:vg_nvme/lv_2 2024-02-19T21:54:31.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:30.324256+0000 mgr.smithi099.zfglya (mgr.14180) 100 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:33.634 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:32.324480+0000 mgr.smithi099.zfglya (mgr.14180) 101 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:33.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:32.324480+0000 mgr.smithi099.zfglya (mgr.14180) 101 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:34.551 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:34.284461+0000 mon.smithi099 (mon.0) 311 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:54:34.552 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:34.286272+0000 mon.smithi099 (mon.0) 312 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:54:34.552 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:34.286735+0000 mon.smithi099 (mon.0) 313 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:34.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:34.284461+0000 mon.smithi099 (mon.0) 311 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:54:34.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:34.286272+0000 mon.smithi099 (mon.0) 312 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:54:34.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:34.286735+0000 mon.smithi099 (mon.0) 313 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:35.855 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:34.282461+0000 mgr.smithi099.zfglya (mgr.14180) 102 : audit [DBG] from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:54:35.855 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:34.324735+0000 mgr.smithi099.zfglya (mgr.14180) 103 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:35.855 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:54:34.796904+0000 mgr.smithi099.zfglya (mgr.14180) 104 : cephadm [INF] Detected new or changed devices on smithi099 2024-02-19T21:54:35.855 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:34.802076+0000 mon.smithi099 (mon.0) 314 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:35.855 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:34.802874+0000 mon.smithi099 (mon.0) 315 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:54:35.855 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:34.803416+0000 mon.smithi099 (mon.0) 316 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:54:35.856 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:54:34.803797+0000 mgr.smithi099.zfglya (mgr.14180) 105 : cephadm [INF] Adjusting osd_memory_target on smithi099 to 6449M 2024-02-19T21:54:35.856 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:34.806791+0000 mon.smithi099 (mon.0) 317 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:35.856 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:34.807507+0000 mon.smithi099 (mon.0) 318 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:35.856 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:34.808041+0000 mon.smithi099 (mon.0) 319 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:54:35.856 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:34.811548+0000 mon.smithi099 (mon.0) 320 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:35.856 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:34.815309+0000 mon.smithi099 (mon.0) 321 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:54:36.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:34.282461+0000 mgr.smithi099.zfglya (mgr.14180) 102 : audit [DBG] from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:54:36.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:34.324735+0000 mgr.smithi099.zfglya (mgr.14180) 103 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:36.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:54:34.796904+0000 mgr.smithi099.zfglya (mgr.14180) 104 : cephadm [INF] Detected new or changed devices on smithi099 2024-02-19T21:54:36.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:34.802076+0000 mon.smithi099 (mon.0) 314 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:36.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:34.802874+0000 mon.smithi099 (mon.0) 315 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:54:36.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:34.803416+0000 mon.smithi099 (mon.0) 316 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:54:36.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:54:34.803797+0000 mgr.smithi099.zfglya (mgr.14180) 105 : cephadm [INF] Adjusting osd_memory_target on smithi099 to 6449M 2024-02-19T21:54:36.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:34.806791+0000 mon.smithi099 (mon.0) 317 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:36.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:34.807507+0000 mon.smithi099 (mon.0) 318 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:36.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:34.808041+0000 mon.smithi099 (mon.0) 319 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:54:36.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:34.811548+0000 mon.smithi099 (mon.0) 320 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:36.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:34.815309+0000 mon.smithi099 (mon.0) 321 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:54:38.130 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:36.324977+0000 mgr.smithi099.zfglya (mgr.14180) 106 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:38.130 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:37.094354+0000 mon.smithi099 (mon.0) 322 : audit [INF] from='client.? 172.21.15.99:0/3325744378' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f71e815-b7bb-46f5-9a1b-1079a065be83"}]: dispatch 2024-02-19T21:54:38.131 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:37.100743+0000 mon.smithi099 (mon.0) 323 : audit [INF] from='client.? 172.21.15.99:0/3325744378' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f71e815-b7bb-46f5-9a1b-1079a065be83"}]': finished 2024-02-19T21:54:38.131 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:37.100783+0000 mon.smithi099 (mon.0) 324 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-19T21:54:38.131 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:37.100929+0000 mon.smithi099 (mon.0) 325 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:54:38.131 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:37.775819+0000 mon.smithi099 (mon.0) 326 : audit [DBG] from='client.? 172.21.15.99:0/1409273079' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:54:38.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:36.324977+0000 mgr.smithi099.zfglya (mgr.14180) 106 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:38.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:37.094354+0000 mon.smithi099 (mon.0) 322 : audit [INF] from='client.? 172.21.15.99:0/3325744378' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f71e815-b7bb-46f5-9a1b-1079a065be83"}]: dispatch 2024-02-19T21:54:38.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:37.100743+0000 mon.smithi099 (mon.0) 323 : audit [INF] from='client.? 172.21.15.99:0/3325744378' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f71e815-b7bb-46f5-9a1b-1079a065be83"}]': finished 2024-02-19T21:54:38.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:37.100783+0000 mon.smithi099 (mon.0) 324 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-19T21:54:38.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:37.100929+0000 mon.smithi099 (mon.0) 325 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:54:38.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:37.775819+0000 mon.smithi099 (mon.0) 326 : audit [DBG] from='client.? 172.21.15.99:0/1409273079' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:54:39.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:38.325363+0000 mgr.smithi099.zfglya (mgr.14180) 107 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:40.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:38.325363+0000 mgr.smithi099.zfglya (mgr.14180) 107 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:41.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:40.325737+0000 mgr.smithi099.zfglya (mgr.14180) 108 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:41.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:40.760202+0000 mon.smithi099 (mon.0) 327 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:41.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:40.760947+0000 mon.smithi099 (mon.0) 328 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:41.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:40.761545+0000 mon.smithi099 (mon.0) 329 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:54:41.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:40.765413+0000 mon.smithi099 (mon.0) 330 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:42.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:40.325737+0000 mgr.smithi099.zfglya (mgr.14180) 108 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:42.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:40.760202+0000 mon.smithi099 (mon.0) 327 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:42.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:40.760947+0000 mon.smithi099 (mon.0) 328 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:42.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:40.761545+0000 mon.smithi099 (mon.0) 329 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:54:42.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:40.765413+0000 mon.smithi099 (mon.0) 330 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:44.034 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:42.326058+0000 mgr.smithi099.zfglya (mgr.14180) 109 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:44.034 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:43.338046+0000 mon.smithi099 (mon.0) 331 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T21:54:44.034 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:43.338644+0000 mon.smithi099 (mon.0) 332 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:44.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:42.326058+0000 mgr.smithi099.zfglya (mgr.14180) 109 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:44.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:43.338046+0000 mon.smithi099 (mon.0) 331 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T21:54:44.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:43.338644+0000 mon.smithi099 (mon.0) 332 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:54:44.932 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:54:43.339109+0000 mgr.smithi099.zfglya (mgr.14180) 110 : cephadm [INF] Deploying daemon osd.2 on smithi099 2024-02-19T21:54:45.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:54:43.339109+0000 mgr.smithi099.zfglya (mgr.14180) 110 : cephadm [INF] Deploying daemon osd.2 on smithi099 2024-02-19T21:54:46.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:44.326357+0000 mgr.smithi099.zfglya (mgr.14180) 111 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:46.062 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:44.326357+0000 mgr.smithi099.zfglya (mgr.14180) 111 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:47.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:46.326642+0000 mgr.smithi099.zfglya (mgr.14180) 112 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:48.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:46.326642+0000 mgr.smithi099.zfglya (mgr.14180) 112 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:49.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:48.327209+0000 mgr.smithi099.zfglya (mgr.14180) 113 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:49.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:48.447051+0000 mon.smithi099 (mon.0) 333 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:49.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:48.447335+0000 mon.smithi099 (mon.0) 334 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:54:49.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:48.327209+0000 mgr.smithi099.zfglya (mgr.14180) 113 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:49.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:48.447051+0000 mon.smithi099 (mon.0) 333 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:49.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:48.447335+0000 mon.smithi099 (mon.0) 334 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:54:51.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:50.327469+0000 mgr.smithi099.zfglya (mgr.14180) 114 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:51.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:50.327469+0000 mgr.smithi099.zfglya (mgr.14180) 114 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:52.357 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 2 on host 'smithi099' 2024-02-19T21:54:52.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:51.545147+0000 mon.smithi099 (mon.0) 335 : audit [INF] from='osd.2 [v2:172.21.15.99:6818/2385653580,v1:172.21.15.99:6819/2385653580]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T21:54:52.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:52.357062+0000 mon.smithi099 (mon.0) 336 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:52.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:51.545147+0000 mon.smithi099 (mon.0) 335 : audit [INF] from='osd.2 [v2:172.21.15.99:6818/2385653580,v1:172.21.15.99:6819/2385653580]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T21:54:52.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:52.357062+0000 mon.smithi099 (mon.0) 336 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:53.248 DEBUG:teuthology.orchestra.run.smithi099:osd.2> sudo journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.2.service 2024-02-19T21:54:53.250 INFO:tasks.cephadm:Deploying osd.3 on smithi099 with /dev/vg_nvme/lv_1... 2024-02-19T21:54:53.250 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-19T21:54:53.280 INFO:journalctl@ceph.osd.2.smithi099.stdout:-- Logs begin at Mon 2024-02-19 21:38:19 UTC. -- 2024-02-19T21:54:53.698 INFO:journalctl@ceph.osd.2.smithi099.stdout:Feb 19 21:54:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-2[62358]: debug 2024-02-19T21:54:53.465+0000 7f9d1e777700 -1 osd.2 0 waiting for initial osdmap 2024-02-19T21:54:53.698 INFO:journalctl@ceph.osd.2.smithi099.stdout:Feb 19 21:54:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-2[62358]: debug 2024-02-19T21:54:53.469+0000 7f9d18eef700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:54:53.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:52.327694+0000 mgr.smithi099.zfglya (mgr.14180) 115 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:53.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:52.461197+0000 mon.smithi099 (mon.0) 337 : audit [INF] from='osd.2 [v2:172.21.15.99:6818/2385653580,v1:172.21.15.99:6819/2385653580]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T21:54:53.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:52.461250+0000 mon.smithi099 (mon.0) 338 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-19T21:54:53.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:52.461349+0000 mon.smithi099 (mon.0) 339 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:54:53.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:52.461648+0000 mon.smithi099 (mon.0) 340 : audit [INF] from='osd.2 [v2:172.21.15.99:6818/2385653580,v1:172.21.15.99:6819/2385653580]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-02-19T21:54:53.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:52.327694+0000 mgr.smithi099.zfglya (mgr.14180) 115 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:53.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:52.461197+0000 mon.smithi099 (mon.0) 337 : audit [INF] from='osd.2 [v2:172.21.15.99:6818/2385653580,v1:172.21.15.99:6819/2385653580]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T21:54:53.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:52.461250+0000 mon.smithi099 (mon.0) 338 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-19T21:54:53.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:52.461349+0000 mon.smithi099 (mon.0) 339 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:54:53.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:52.461648+0000 mon.smithi099 (mon.0) 340 : audit [INF] from='osd.2 [v2:172.21.15.99:6818/2385653580,v1:172.21.15.99:6819/2385653580]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-02-19T21:54:55.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:53.462304+0000 mon.smithi099 (mon.0) 341 : audit [INF] from='osd.2 [v2:172.21.15.99:6818/2385653580,v1:172.21.15.99:6819/2385653580]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-02-19T21:54:55.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:53.462359+0000 mon.smithi099 (mon.0) 342 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2024-02-19T21:54:55.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:53.462700+0000 mon.smithi099 (mon.0) 343 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:54:55.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:53.466471+0000 mon.smithi099 (mon.0) 344 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:54:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:53.462304+0000 mon.smithi099 (mon.0) 341 : audit [INF] from='osd.2 [v2:172.21.15.99:6818/2385653580,v1:172.21.15.99:6819/2385653580]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-02-19T21:54:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:53.462359+0000 mon.smithi099 (mon.0) 342 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2024-02-19T21:54:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:53.462700+0000 mon.smithi099 (mon.0) 343 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:54:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:53.466471+0000 mon.smithi099 (mon.0) 344 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:54:55.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:52.547750+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:55.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:52.547794+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:55.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:54.328025+0000 mgr.smithi099.zfglya (mgr.14180) 116 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:55.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:54.467110+0000 mon.smithi099 (mon.0) 345 : cluster [INF] osd.2 [v2:172.21.15.99:6818/2385653580,v1:172.21.15.99:6819/2385653580] boot 2024-02-19T21:54:55.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:54.467142+0000 mon.smithi099 (mon.0) 346 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-19T21:54:55.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:54.467598+0000 mon.smithi099 (mon.0) 347 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:54:55.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:54.467947+0000 mon.smithi099 (mon.0) 348 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-19T21:54:55.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:55.471312+0000 mon.smithi099 (mon.0) 349 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-19T21:54:55.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:55.471368+0000 mon.smithi099 (mon.0) 350 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-19T21:54:55.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:55.473300+0000 mon.smithi099 (mon.0) 351 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-19T21:54:56.116 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:52.547750+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:54:56.116 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:52.547794+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:54:56.116 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:54.328025+0000 mgr.smithi099.zfglya (mgr.14180) 116 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-19T21:54:56.116 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:54.467110+0000 mon.smithi099 (mon.0) 345 : cluster [INF] osd.2 [v2:172.21.15.99:6818/2385653580,v1:172.21.15.99:6819/2385653580] boot 2024-02-19T21:54:56.117 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:54.467142+0000 mon.smithi099 (mon.0) 346 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-19T21:54:56.117 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:54.467598+0000 mon.smithi099 (mon.0) 347 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T21:54:56.117 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:54.467947+0000 mon.smithi099 (mon.0) 348 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-19T21:54:56.117 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:55.471312+0000 mon.smithi099 (mon.0) 349 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-19T21:54:56.117 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:55.471368+0000 mon.smithi099 (mon.0) 350 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-19T21:54:56.117 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:55.473300+0000 mon.smithi099 (mon.0) 351 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-19T21:54:57.011 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-19T21:54:57.011 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-19T21:54:57.011 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-02-19T21:54:57.011 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-02-19T21:54:57.011 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114156 s, 919 MB/s 2024-02-19T21:54:57.011 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-02-19T21:54:57.596 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:56.328391+0000 mgr.smithi099.zfglya (mgr.14180) 117 : cluster [DBG] pgmap v85: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:54:57.596 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:56.470277+0000 mon.smithi099 (mon.0) 352 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-19T21:54:57.596 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:56.470375+0000 mon.smithi099 (mon.0) 353 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-19T21:54:57.596 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:54:56.766152+0000 mon.smithi099 (mon.0) 354 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:57.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:56.328391+0000 mgr.smithi099.zfglya (mgr.14180) 117 : cluster [DBG] pgmap v85: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:54:57.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:56.470277+0000 mon.smithi099 (mon.0) 352 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-19T21:54:57.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:56.470375+0000 mon.smithi099 (mon.0) 353 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-19T21:54:57.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:54:56.766152+0000 mon.smithi099 (mon.0) 354 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:54:58.697 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi099:vg_nvme/lv_1 2024-02-19T21:54:58.924 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:57.767597+0000 mon.smithi099 (mon.0) 355 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-19T21:54:59.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:57.767597+0000 mon.smithi099 (mon.0) 355 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-19T21:55:00.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:54:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:54:58.328893+0000 mgr.smithi099.zfglya (mgr.14180) 118 : cluster [DBG] pgmap v88: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:00.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:54:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:54:58.328893+0000 mgr.smithi099.zfglya (mgr.14180) 118 : cluster [DBG] pgmap v88: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:02.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:00.329380+0000 mgr.smithi099.zfglya (mgr.14180) 119 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:02.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:01.131086+0000 mon.smithi099 (mon.0) 356 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:02.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:01.131932+0000 mon.smithi099 (mon.0) 357 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:02.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:01.132517+0000 mon.smithi099 (mon.0) 358 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:02.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:01.133035+0000 mon.smithi099 (mon.0) 359 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:02.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:01.137255+0000 mon.smithi099 (mon.0) 360 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:02.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:01.138108+0000 mon.smithi099 (mon.0) 361 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:02.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:01.138680+0000 mon.smithi099 (mon.0) 362 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:02.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:01.142559+0000 mon.smithi099 (mon.0) 363 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:02.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:01.145742+0000 mon.smithi099 (mon.0) 364 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:55:02.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:01.561052+0000 mon.smithi099 (mon.0) 365 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:55:02.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:01.562934+0000 mon.smithi099 (mon.0) 366 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:55:02.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:01.563508+0000 mon.smithi099 (mon.0) 367 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:02.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:00.329380+0000 mgr.smithi099.zfglya (mgr.14180) 119 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:01.131086+0000 mon.smithi099 (mon.0) 356 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:01.131932+0000 mon.smithi099 (mon.0) 357 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:01.132517+0000 mon.smithi099 (mon.0) 358 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:01.133035+0000 mon.smithi099 (mon.0) 359 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:01.137255+0000 mon.smithi099 (mon.0) 360 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:01.138108+0000 mon.smithi099 (mon.0) 361 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:01.138680+0000 mon.smithi099 (mon.0) 362 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:01.142559+0000 mon.smithi099 (mon.0) 363 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:01.145742+0000 mon.smithi099 (mon.0) 364 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:55:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:01.561052+0000 mon.smithi099 (mon.0) 365 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:55:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:01.562934+0000 mon.smithi099 (mon.0) 366 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:55:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:01.563508+0000 mon.smithi099 (mon.0) 367 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:03.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:55:01.126489+0000 mgr.smithi099.zfglya (mgr.14180) 120 : cephadm [INF] Detected new or changed devices on smithi099 2024-02-19T21:55:03.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:55:01.133499+0000 mgr.smithi099.zfglya (mgr.14180) 121 : cephadm [INF] Adjusting osd_memory_target on smithi099 to 4299M 2024-02-19T21:55:03.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:01.558991+0000 mgr.smithi099.zfglya (mgr.14180) 122 : audit [DBG] from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:55:03.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:55:01.126489+0000 mgr.smithi099.zfglya (mgr.14180) 120 : cephadm [INF] Detected new or changed devices on smithi099 2024-02-19T21:55:03.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:55:01.133499+0000 mgr.smithi099.zfglya (mgr.14180) 121 : cephadm [INF] Adjusting osd_memory_target on smithi099 to 4299M 2024-02-19T21:55:03.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:01.558991+0000 mgr.smithi099.zfglya (mgr.14180) 122 : audit [DBG] from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:55:04.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:02.329695+0000 mgr.smithi099.zfglya (mgr.14180) 123 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:04.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:02.329695+0000 mgr.smithi099.zfglya (mgr.14180) 123 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:06.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:04.330040+0000 mgr.smithi099.zfglya (mgr.14180) 124 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:06.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:04.969317+0000 mon.smithi099 (mon.0) 368 : audit [INF] from='client.? 172.21.15.99:0/348850880' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "caf76464-0af6-40fa-b596-87796509feea"}]: dispatch 2024-02-19T21:55:06.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:04.973114+0000 mon.smithi099 (mon.0) 369 : audit [INF] from='client.? 172.21.15.99:0/348850880' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "caf76464-0af6-40fa-b596-87796509feea"}]': finished 2024-02-19T21:55:06.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:04.973162+0000 mon.smithi099 (mon.0) 370 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-19T21:55:06.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:04.973269+0000 mon.smithi099 (mon.0) 371 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:55:06.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:05.568690+0000 mon.smithi099 (mon.0) 372 : audit [DBG] from='client.? 172.21.15.99:0/475306869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:55:06.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:04.330040+0000 mgr.smithi099.zfglya (mgr.14180) 124 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:06.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:04.969317+0000 mon.smithi099 (mon.0) 368 : audit [INF] from='client.? 172.21.15.99:0/348850880' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "caf76464-0af6-40fa-b596-87796509feea"}]: dispatch 2024-02-19T21:55:06.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:04.973114+0000 mon.smithi099 (mon.0) 369 : audit [INF] from='client.? 172.21.15.99:0/348850880' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "caf76464-0af6-40fa-b596-87796509feea"}]': finished 2024-02-19T21:55:06.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:04.973162+0000 mon.smithi099 (mon.0) 370 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-19T21:55:06.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:04.973269+0000 mon.smithi099 (mon.0) 371 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:55:06.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:05.568690+0000 mon.smithi099 (mon.0) 372 : audit [DBG] from='client.? 172.21.15.99:0/475306869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:55:08.108 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:06.330484+0000 mgr.smithi099.zfglya (mgr.14180) 125 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:08.108 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:06.830518+0000 mon.smithi099 (mon.0) 373 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:08.108 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:06.831248+0000 mon.smithi099 (mon.0) 374 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:08.108 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:06.831794+0000 mon.smithi099 (mon.0) 375 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:08.109 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:06.837782+0000 mon.smithi099 (mon.0) 376 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:08.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:06.330484+0000 mgr.smithi099.zfglya (mgr.14180) 125 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:08.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:06.830518+0000 mon.smithi099 (mon.0) 373 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:08.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:06.831248+0000 mon.smithi099 (mon.0) 374 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:08.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:06.831794+0000 mon.smithi099 (mon.0) 375 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:08.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:06.837782+0000 mon.smithi099 (mon.0) 376 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:10.133 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:08.330844+0000 mgr.smithi099.zfglya (mgr.14180) 126 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:08.330844+0000 mgr.smithi099.zfglya (mgr.14180) 126 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:11.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:10.331173+0000 mgr.smithi099.zfglya (mgr.14180) 127 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:11.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:11.229888+0000 mon.smithi099 (mon.0) 377 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T21:55:11.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:11.230452+0000 mon.smithi099 (mon.0) 378 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:12.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:10.331173+0000 mgr.smithi099.zfglya (mgr.14180) 127 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:12.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:11.229888+0000 mon.smithi099 (mon.0) 377 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T21:55:12.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:11.230452+0000 mon.smithi099 (mon.0) 378 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:13.013 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:55:11.230899+0000 mgr.smithi099.zfglya (mgr.14180) 128 : cephadm [INF] Deploying daemon osd.3 on smithi099 2024-02-19T21:55:13.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:55:11.230899+0000 mgr.smithi099.zfglya (mgr.14180) 128 : cephadm [INF] Deploying daemon osd.3 on smithi099 2024-02-19T21:55:13.996 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:12.331488+0000 mgr.smithi099.zfglya (mgr.14180) 129 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:14.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:12.331488+0000 mgr.smithi099.zfglya (mgr.14180) 129 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:16.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:14.331821+0000 mgr.smithi099.zfglya (mgr.14180) 130 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:16.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:14.331821+0000 mgr.smithi099.zfglya (mgr.14180) 130 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:17.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:16.332121+0000 mgr.smithi099.zfglya (mgr.14180) 131 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:17.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:16.455707+0000 mon.smithi099 (mon.0) 379 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:17.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:16.474467+0000 mon.smithi099 (mon.0) 380 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:55:17.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:16.332121+0000 mgr.smithi099.zfglya (mgr.14180) 131 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:17.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:16.455707+0000 mon.smithi099 (mon.0) 379 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:17.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:16.474467+0000 mon.smithi099 (mon.0) 380 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:55:19.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:18.332451+0000 mgr.smithi099.zfglya (mgr.14180) 132 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:19.815 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:18.332451+0000 mgr.smithi099.zfglya (mgr.14180) 132 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:19.839 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 3 on host 'smithi099' 2024-02-19T21:55:20.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:19.585578+0000 mon.smithi099 (mon.0) 381 : audit [INF] from='osd.3 [v2:172.21.15.99:6826/2645326065,v1:172.21.15.99:6827/2645326065]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T21:55:20.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:19.839766+0000 mon.smithi099 (mon.0) 382 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:20.849 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:19.585578+0000 mon.smithi099 (mon.0) 381 : audit [INF] from='osd.3 [v2:172.21.15.99:6826/2645326065,v1:172.21.15.99:6827/2645326065]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T21:55:20.850 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:19.839766+0000 mon.smithi099 (mon.0) 382 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:21.161 DEBUG:teuthology.orchestra.run.smithi099:osd.3> sudo journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.3.service 2024-02-19T21:55:21.164 INFO:tasks.cephadm:Deploying osd.4 on smithi138 with /dev/vg_nvme/lv_4... 2024-02-19T21:55:21.164 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-19T21:55:21.199 INFO:journalctl@ceph.osd.3.smithi099.stdout:-- Logs begin at Mon 2024-02-19 21:38:19 UTC. -- 2024-02-19T21:55:21.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:20.332863+0000 mgr.smithi099.zfglya (mgr.14180) 133 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:21.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:20.467132+0000 mon.smithi099 (mon.0) 383 : audit [INF] from='osd.3 [v2:172.21.15.99:6826/2645326065,v1:172.21.15.99:6827/2645326065]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-19T21:55:21.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:20.467172+0000 mon.smithi099 (mon.0) 384 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-19T21:55:21.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:20.467296+0000 mon.smithi099 (mon.0) 385 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:55:21.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:20.467619+0000 mon.smithi099 (mon.0) 386 : audit [INF] from='osd.3 [v2:172.21.15.99:6826/2645326065,v1:172.21.15.99:6827/2645326065]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-02-19T21:55:21.948 INFO:journalctl@ceph.osd.3.smithi099.stdout:Feb 19 21:55:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-3[67792]: debug 2024-02-19T21:55:21.473+0000 7f31c923e700 -1 osd.3 0 waiting for initial osdmap 2024-02-19T21:55:21.949 INFO:journalctl@ceph.osd.3.smithi099.stdout:Feb 19 21:55:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-3[67792]: debug 2024-02-19T21:55:21.478+0000 7f31c19b2700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:55:21.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:20.332863+0000 mgr.smithi099.zfglya (mgr.14180) 133 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:21.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:20.467132+0000 mon.smithi099 (mon.0) 383 : audit [INF] from='osd.3 [v2:172.21.15.99:6826/2645326065,v1:172.21.15.99:6827/2645326065]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-19T21:55:21.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:20.467172+0000 mon.smithi099 (mon.0) 384 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-19T21:55:21.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:20.467296+0000 mon.smithi099 (mon.0) 385 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:55:21.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:20.467619+0000 mon.smithi099 (mon.0) 386 : audit [INF] from='osd.3 [v2:172.21.15.99:6826/2645326065,v1:172.21.15.99:6827/2645326065]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-02-19T21:55:22.748 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:21.471603+0000 mon.smithi099 (mon.0) 387 : audit [INF] from='osd.3 [v2:172.21.15.99:6826/2645326065,v1:172.21.15.99:6827/2645326065]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-02-19T21:55:22.748 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:21.471653+0000 mon.smithi099 (mon.0) 388 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-02-19T21:55:22.748 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:21.472094+0000 mon.smithi099 (mon.0) 389 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:55:22.749 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:21.476526+0000 mon.smithi099 (mon.0) 390 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:55:22.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:21.471603+0000 mon.smithi099 (mon.0) 387 : audit [INF] from='osd.3 [v2:172.21.15.99:6826/2645326065,v1:172.21.15.99:6827/2645326065]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-02-19T21:55:22.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:21.471653+0000 mon.smithi099 (mon.0) 388 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-02-19T21:55:22.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:21.472094+0000 mon.smithi099 (mon.0) 389 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:55:22.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:21.476526+0000 mon.smithi099 (mon.0) 390 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:55:23.574 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-19T21:55:23.574 INFO:teuthology.orchestra.run.smithi138.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-19T21:55:23.574 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10+0 records in 2024-02-19T21:55:23.574 INFO:teuthology.orchestra.run.smithi138.stderr:10+0 records out 2024-02-19T21:55:23.574 INFO:teuthology.orchestra.run.smithi138.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0147411 s, 711 MB/s 2024-02-19T21:55:23.574 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping successful for: 2024-02-19T21:55:23.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:20.628275+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:23.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:20.628326+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:23.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:22.333375+0000 mgr.smithi099.zfglya (mgr.14180) 134 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:23.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:22.476413+0000 mon.smithi099 (mon.0) 391 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:55:23.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:22.479291+0000 mon.smithi099 (mon.0) 392 : cluster [INF] osd.3 [v2:172.21.15.99:6826/2645326065,v1:172.21.15.99:6827/2645326065] boot 2024-02-19T21:55:23.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:22.479316+0000 mon.smithi099 (mon.0) 393 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-19T21:55:23.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:22.479671+0000 mon.smithi099 (mon.0) 394 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:55:23.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:20.628275+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:23.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:20.628326+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:23.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:22.333375+0000 mgr.smithi099.zfglya (mgr.14180) 134 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-19T21:55:23.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:22.476413+0000 mon.smithi099 (mon.0) 391 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:55:23.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:22.479291+0000 mon.smithi099 (mon.0) 392 : cluster [INF] osd.3 [v2:172.21.15.99:6826/2645326065,v1:172.21.15.99:6827/2645326065] boot 2024-02-19T21:55:23.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:22.479316+0000 mon.smithi099 (mon.0) 393 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-19T21:55:23.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:22.479671+0000 mon.smithi099 (mon.0) 394 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T21:55:24.276 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi138:vg_nvme/lv_4 2024-02-19T21:55:24.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:23.488801+0000 mon.smithi099 (mon.0) 395 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-19T21:55:24.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:23.563473+0000 mon.smithi099 (mon.0) 396 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:24.673 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:23.488801+0000 mon.smithi099 (mon.0) 395 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-19T21:55:24.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:23.563473+0000 mon.smithi099 (mon.0) 396 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:25.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:24.333640+0000 mgr.smithi099.zfglya (mgr.14180) 135 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:25.911 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:24.333640+0000 mgr.smithi099.zfglya (mgr.14180) 135 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:27.839 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:26.333939+0000 mgr.smithi099.zfglya (mgr.14180) 136 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:27.840 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:26.583077+0000 mgr.smithi099.zfglya (mgr.14180) 137 : audit [DBG] from='client.24139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:55:27.840 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:26.586553+0000 mon.smithi099 (mon.0) 397 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:55:27.840 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:26.588627+0000 mon.smithi099 (mon.0) 398 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:55:27.840 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:26.589139+0000 mon.smithi099 (mon.0) 399 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:27.840 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:55:26.766298+0000 mgr.smithi099.zfglya (mgr.14180) 138 : cephadm [INF] Detected new or changed devices on smithi099 2024-02-19T21:55:27.840 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:26.771266+0000 mon.smithi099 (mon.0) 400 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:27.840 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:27.049846+0000 mon.smithi099 (mon.0) 401 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:27.840 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:27.050452+0000 mon.smithi099 (mon.0) 402 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:27.840 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:27.050952+0000 mon.smithi099 (mon.0) 403 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:27.840 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:27.051452+0000 mon.smithi099 (mon.0) 404 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:27.840 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:55:27.051834+0000 mgr.smithi099.zfglya (mgr.14180) 139 : cephadm [INF] Adjusting osd_memory_target on smithi099 to 3224M 2024-02-19T21:55:27.841 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:27.055947+0000 mon.smithi099 (mon.0) 405 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:27.841 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:27.056679+0000 mon.smithi099 (mon.0) 406 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:27.841 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:27.057253+0000 mon.smithi099 (mon.0) 407 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:27.841 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:27.060970+0000 mon.smithi099 (mon.0) 408 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:27.841 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:27.064823+0000 mon.smithi099 (mon.0) 409 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:55:27.841 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:27.066004+0000 mon.smithi099 (mon.0) 410 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:27.841 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:27.066565+0000 mon.smithi099 (mon.0) 411 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:27.841 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:27.070316+0000 mon.smithi099 (mon.0) 412 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:27.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:26.333939+0000 mgr.smithi099.zfglya (mgr.14180) 136 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:27.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:26.583077+0000 mgr.smithi099.zfglya (mgr.14180) 137 : audit [DBG] from='client.24139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:55:27.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:26.586553+0000 mon.smithi099 (mon.0) 397 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:55:27.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:26.588627+0000 mon.smithi099 (mon.0) 398 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:55:27.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:26.589139+0000 mon.smithi099 (mon.0) 399 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:27.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:55:26.766298+0000 mgr.smithi099.zfglya (mgr.14180) 138 : cephadm [INF] Detected new or changed devices on smithi099 2024-02-19T21:55:27.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:26.771266+0000 mon.smithi099 (mon.0) 400 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:27.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:27.049846+0000 mon.smithi099 (mon.0) 401 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:27.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:27.050452+0000 mon.smithi099 (mon.0) 402 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:27.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:27.050952+0000 mon.smithi099 (mon.0) 403 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:27.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:27.051452+0000 mon.smithi099 (mon.0) 404 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:27.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:55:27.051834+0000 mgr.smithi099.zfglya (mgr.14180) 139 : cephadm [INF] Adjusting osd_memory_target on smithi099 to 3224M 2024-02-19T21:55:27.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:27.055947+0000 mon.smithi099 (mon.0) 405 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:27.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:27.056679+0000 mon.smithi099 (mon.0) 406 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:27.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:27.057253+0000 mon.smithi099 (mon.0) 407 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:27.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:27.060970+0000 mon.smithi099 (mon.0) 408 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:27.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:27.064823+0000 mon.smithi099 (mon.0) 409 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:55:27.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:27.066004+0000 mon.smithi099 (mon.0) 410 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:27.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:27.066565+0000 mon.smithi099 (mon.0) 411 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:27.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:27.070316+0000 mon.smithi099 (mon.0) 412 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:29.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:28.334319+0000 mgr.smithi099.zfglya (mgr.14180) 140 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:29.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:29.144799+0000 mon.smithi138 (mon.1) 2 : audit [INF] from='client.? 172.21.15.138:0/1416161201' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7440d499-f65f-4aab-94c1-2a282913ca19"}]: dispatch 2024-02-19T21:55:29.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:29.145359+0000 mon.smithi099 (mon.0) 413 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7440d499-f65f-4aab-94c1-2a282913ca19"}]: dispatch 2024-02-19T21:55:29.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:29.149901+0000 mon.smithi099 (mon.0) 414 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7440d499-f65f-4aab-94c1-2a282913ca19"}]': finished 2024-02-19T21:55:29.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:29.149964+0000 mon.smithi099 (mon.0) 415 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-02-19T21:55:29.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:29.150089+0000 mon.smithi099 (mon.0) 416 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:55:30.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:28.334319+0000 mgr.smithi099.zfglya (mgr.14180) 140 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:30.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:29.144799+0000 mon.smithi138 (mon.1) 2 : audit [INF] from='client.? 172.21.15.138:0/1416161201' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7440d499-f65f-4aab-94c1-2a282913ca19"}]: dispatch 2024-02-19T21:55:30.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:29.145359+0000 mon.smithi099 (mon.0) 413 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7440d499-f65f-4aab-94c1-2a282913ca19"}]: dispatch 2024-02-19T21:55:30.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:29.149901+0000 mon.smithi099 (mon.0) 414 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7440d499-f65f-4aab-94c1-2a282913ca19"}]': finished 2024-02-19T21:55:30.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:29.149964+0000 mon.smithi099 (mon.0) 415 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-02-19T21:55:30.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:29.150089+0000 mon.smithi099 (mon.0) 416 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:55:30.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:29.725550+0000 mon.smithi138 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.138:0/1953156969' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:55:31.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:29.725550+0000 mon.smithi138 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.138:0/1953156969' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:55:31.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:30.334812+0000 mgr.smithi099.zfglya (mgr.14180) 141 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:31.982 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:30.334812+0000 mgr.smithi099.zfglya (mgr.14180) 141 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:33.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:32.335269+0000 mgr.smithi099.zfglya (mgr.14180) 142 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:34.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:32.335269+0000 mgr.smithi099.zfglya (mgr.14180) 142 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:35.840 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:34.335639+0000 mgr.smithi099.zfglya (mgr.14180) 143 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:35.840 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:35.339625+0000 mon.smithi099 (mon.0) 417 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T21:55:35.841 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:35.340343+0000 mon.smithi099 (mon.0) 418 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:35.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:34.335639+0000 mgr.smithi099.zfglya (mgr.14180) 143 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:35.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:35.339625+0000 mon.smithi099 (mon.0) 417 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T21:55:35.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:35.340343+0000 mon.smithi099 (mon.0) 418 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:36.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:55:35.340963+0000 mgr.smithi099.zfglya (mgr.14180) 144 : cephadm [INF] Deploying daemon osd.4 on smithi138 2024-02-19T21:55:36.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:55:35.340963+0000 mgr.smithi099.zfglya (mgr.14180) 144 : cephadm [INF] Deploying daemon osd.4 on smithi138 2024-02-19T21:55:37.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:36.336093+0000 mgr.smithi099.zfglya (mgr.14180) 145 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:38.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:36.336093+0000 mgr.smithi099.zfglya (mgr.14180) 145 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:39.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:38.336450+0000 mgr.smithi099.zfglya (mgr.14180) 146 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:39.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:38.336450+0000 mgr.smithi099.zfglya (mgr.14180) 146 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:42.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:40.336904+0000 mgr.smithi099.zfglya (mgr.14180) 147 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:42.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:40.892556+0000 mon.smithi099 (mon.0) 419 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:42.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:40.920239+0000 mon.smithi099 (mon.0) 420 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:55:42.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:40.336904+0000 mgr.smithi099.zfglya (mgr.14180) 147 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:42.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:40.892556+0000 mon.smithi099 (mon.0) 419 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:42.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:40.920239+0000 mon.smithi099 (mon.0) 420 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:55:44.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:42.337237+0000 mgr.smithi099.zfglya (mgr.14180) 148 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:44.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:42.337237+0000 mgr.smithi099.zfglya (mgr.14180) 148 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:44.588 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 4 on host 'smithi138' 2024-02-19T21:55:45.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:43.981982+0000 mon.smithi138 (mon.1) 4 : audit [INF] from='osd.4 [v2:172.21.15.138:6800/3461120502,v1:172.21.15.138:6801/3461120502]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T21:55:45.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:43.982621+0000 mon.smithi099 (mon.0) 421 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T21:55:45.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:44.587883+0000 mon.smithi099 (mon.0) 422 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:45.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:43.981982+0000 mon.smithi138 (mon.1) 4 : audit [INF] from='osd.4 [v2:172.21.15.138:6800/3461120502,v1:172.21.15.138:6801/3461120502]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T21:55:45.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:43.982621+0000 mon.smithi099 (mon.0) 421 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T21:55:45.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:44.587883+0000 mon.smithi099 (mon.0) 422 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:45.399 DEBUG:teuthology.orchestra.run.smithi138:osd.4> sudo journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.4.service 2024-02-19T21:55:45.401 INFO:tasks.cephadm:Deploying osd.5 on smithi138 with /dev/vg_nvme/lv_3... 2024-02-19T21:55:45.402 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-19T21:55:45.437 INFO:journalctl@ceph.osd.4.smithi138.stdout:-- Logs begin at Mon 2024-02-19 21:38:16 UTC. -- 2024-02-19T21:55:46.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:44.337602+0000 mgr.smithi099.zfglya (mgr.14180) 149 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:46.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:44.902011+0000 mon.smithi099 (mon.0) 423 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-19T21:55:46.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:44.902090+0000 mon.smithi099 (mon.0) 424 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-02-19T21:55:46.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:44.902235+0000 mon.smithi099 (mon.0) 425 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:55:46.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:44.902768+0000 mon.smithi138 (mon.1) 5 : audit [INF] from='osd.4 [v2:172.21.15.138:6800/3461120502,v1:172.21.15.138:6801/3461120502]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:55:46.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:44.903215+0000 mon.smithi099 (mon.0) 426 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:55:46.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:45.838739+0000 mon.smithi099 (mon.0) 427 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:46.290 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 21:55:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4[44397]: debug 2024-02-19T21:55:45.909+0000 7f88c50f0700 -1 osd.4 0 waiting for initial osdmap 2024-02-19T21:55:46.290 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 21:55:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4[44397]: debug 2024-02-19T21:55:45.914+0000 7f88c186c700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:55:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:44.337602+0000 mgr.smithi099.zfglya (mgr.14180) 149 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:44.902011+0000 mon.smithi099 (mon.0) 423 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-19T21:55:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:44.902090+0000 mon.smithi099 (mon.0) 424 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-02-19T21:55:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:44.902235+0000 mon.smithi099 (mon.0) 425 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:55:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:44.902768+0000 mon.smithi138 (mon.1) 5 : audit [INF] from='osd.4 [v2:172.21.15.138:6800/3461120502,v1:172.21.15.138:6801/3461120502]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:55:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:44.903215+0000 mon.smithi099 (mon.0) 426 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:55:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:45.838739+0000 mon.smithi099 (mon.0) 427 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:47.002 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:45.904213+0000 mon.smithi099 (mon.0) 428 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-19T21:55:47.002 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:45.904351+0000 mon.smithi099 (mon.0) 429 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-02-19T21:55:47.002 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:45.904746+0000 mon.smithi099 (mon.0) 430 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:55:47.002 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:45.910188+0000 mon.smithi099 (mon.0) 431 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:55:47.002 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:46.905862+0000 mon.smithi099 (mon.0) 432 : cluster [INF] osd.4 [v2:172.21.15.138:6800/3461120502,v1:172.21.15.138:6801/3461120502] boot 2024-02-19T21:55:47.002 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:46.905913+0000 mon.smithi099 (mon.0) 433 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-19T21:55:47.002 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:46.906043+0000 mon.smithi099 (mon.0) 434 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:55:47.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:45.904213+0000 mon.smithi099 (mon.0) 428 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-19T21:55:47.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:45.904351+0000 mon.smithi099 (mon.0) 429 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-02-19T21:55:47.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:45.904746+0000 mon.smithi099 (mon.0) 430 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:55:47.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:45.910188+0000 mon.smithi099 (mon.0) 431 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:55:47.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:46.905862+0000 mon.smithi099 (mon.0) 432 : cluster [INF] osd.4 [v2:172.21.15.138:6800/3461120502,v1:172.21.15.138:6801/3461120502] boot 2024-02-19T21:55:47.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:46.905913+0000 mon.smithi099 (mon.0) 433 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-19T21:55:47.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:46.906043+0000 mon.smithi099 (mon.0) 434 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T21:55:48.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:44.993495+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:48.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:44.993536+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:48.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:46.337981+0000 mgr.smithi099.zfglya (mgr.14180) 150 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:48.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:47.907570+0000 mon.smithi099 (mon.0) 435 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-19T21:55:48.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:44.993495+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:55:48.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:44.993536+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:55:48.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:46.337981+0000 mgr.smithi099.zfglya (mgr.14180) 150 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-19T21:55:48.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:47.907570+0000 mon.smithi099 (mon.0) 435 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-19T21:55:49.356 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-19T21:55:49.357 INFO:teuthology.orchestra.run.smithi138.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-19T21:55:49.357 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10+0 records in 2024-02-19T21:55:49.357 INFO:teuthology.orchestra.run.smithi138.stderr:10+0 records out 2024-02-19T21:55:49.357 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0108806 s, 964 MB/s 2024-02-19T21:55:49.357 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping successful for: 2024-02-19T21:55:50.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:48.338453+0000 mgr.smithi099.zfglya (mgr.14180) 151 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:55:50.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:48.909700+0000 mon.smithi099 (mon.0) 436 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-02-19T21:55:50.271 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:48.338453+0000 mgr.smithi099.zfglya (mgr.14180) 151 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:55:50.271 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:48.909700+0000 mon.smithi099 (mon.0) 436 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-02-19T21:55:50.829 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi138:vg_nvme/lv_3 2024-02-19T21:55:52.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:50.339012+0000 mgr.smithi099.zfglya (mgr.14180) 152 : cluster [DBG] pgmap v125: 1 pgs: 1 activating; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:55:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:55:50.846008+0000 mgr.smithi099.zfglya (mgr.14180) 153 : cephadm [INF] Detected new or changed devices on smithi138 2024-02-19T21:55:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:50.851049+0000 mon.smithi099 (mon.0) 437 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:50.852018+0000 mon.smithi099 (mon.0) 438 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:55:50.852631+0000 mgr.smithi099.zfglya (mgr.14180) 154 : cephadm [INF] Adjusting osd_memory_target on smithi138 to 15970M 2024-02-19T21:55:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:50.856122+0000 mon.smithi099 (mon.0) 439 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:50.857011+0000 mon.smithi099 (mon.0) 440 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:50.857685+0000 mon.smithi099 (mon.0) 441 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:50.861699+0000 mon.smithi099 (mon.0) 442 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:50.865750+0000 mon.smithi099 (mon.0) 443 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:55:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:50.867160+0000 mon.smithi099 (mon.0) 444 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:52.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:50.867787+0000 mon.smithi099 (mon.0) 445 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:52.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:50.871516+0000 mon.smithi099 (mon.0) 446 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:52.273 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:50.339012+0000 mgr.smithi099.zfglya (mgr.14180) 152 : cluster [DBG] pgmap v125: 1 pgs: 1 activating; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:55:52.273 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:55:50.846008+0000 mgr.smithi099.zfglya (mgr.14180) 153 : cephadm [INF] Detected new or changed devices on smithi138 2024-02-19T21:55:52.273 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:50.851049+0000 mon.smithi099 (mon.0) 437 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:52.274 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:50.852018+0000 mon.smithi099 (mon.0) 438 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:55:52.274 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:55:50.852631+0000 mgr.smithi099.zfglya (mgr.14180) 154 : cephadm [INF] Adjusting osd_memory_target on smithi138 to 15970M 2024-02-19T21:55:52.274 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:50.856122+0000 mon.smithi099 (mon.0) 439 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:52.274 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:50.857011+0000 mon.smithi099 (mon.0) 440 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:52.274 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:50.857685+0000 mon.smithi099 (mon.0) 441 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:52.274 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:50.861699+0000 mon.smithi099 (mon.0) 442 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:52.274 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:50.865750+0000 mon.smithi099 (mon.0) 443 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:55:52.274 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:50.867160+0000 mon.smithi099 (mon.0) 444 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:52.274 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:50.867787+0000 mon.smithi099 (mon.0) 445 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:55:52.274 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:50.871516+0000 mon.smithi099 (mon.0) 446 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:55:54.074 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:52.339565+0000 mgr.smithi099.zfglya (mgr.14180) 155 : cluster [DBG] pgmap v126: 1 pgs: 1 activating; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:55:54.074 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:53.059163+0000 mgr.smithi099.zfglya (mgr.14180) 156 : audit [DBG] from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:55:54.074 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:53.061665+0000 mon.smithi099 (mon.0) 447 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:55:54.074 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:53.064030+0000 mon.smithi099 (mon.0) 448 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:55:54.074 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:53.064794+0000 mon.smithi099 (mon.0) 449 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:54.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:52.339565+0000 mgr.smithi099.zfglya (mgr.14180) 155 : cluster [DBG] pgmap v126: 1 pgs: 1 activating; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:55:54.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:53.059163+0000 mgr.smithi099.zfglya (mgr.14180) 156 : audit [DBG] from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:55:54.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:53.061665+0000 mon.smithi099 (mon.0) 447 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:55:54.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:53.064030+0000 mon.smithi099 (mon.0) 448 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:55:54.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:53.064794+0000 mon.smithi099 (mon.0) 449 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:55:56.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:54.339968+0000 mgr.smithi099.zfglya (mgr.14180) 157 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:55:56.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:54.339968+0000 mgr.smithi099.zfglya (mgr.14180) 157 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:55:57.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:56.039297+0000 mon.smithi138 (mon.1) 6 : audit [INF] from='client.? 172.21.15.138:0/3531669030' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bf2ce61-d2cf-460a-8b0a-2cb3a0b4842e"}]: dispatch 2024-02-19T21:55:57.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:56.039943+0000 mon.smithi099 (mon.0) 450 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bf2ce61-d2cf-460a-8b0a-2cb3a0b4842e"}]: dispatch 2024-02-19T21:55:57.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:56.046396+0000 mon.smithi099 (mon.0) 451 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bf2ce61-d2cf-460a-8b0a-2cb3a0b4842e"}]': finished 2024-02-19T21:55:57.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:56.046462+0000 mon.smithi099 (mon.0) 452 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-02-19T21:55:57.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:56.046615+0000 mon.smithi099 (mon.0) 453 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:55:57.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:55:56.627715+0000 mon.smithi138 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.138:0/270906579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:55:57.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:56.039297+0000 mon.smithi138 (mon.1) 6 : audit [INF] from='client.? 172.21.15.138:0/3531669030' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bf2ce61-d2cf-460a-8b0a-2cb3a0b4842e"}]: dispatch 2024-02-19T21:55:57.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:56.039943+0000 mon.smithi099 (mon.0) 450 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bf2ce61-d2cf-460a-8b0a-2cb3a0b4842e"}]: dispatch 2024-02-19T21:55:57.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:56.046396+0000 mon.smithi099 (mon.0) 451 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bf2ce61-d2cf-460a-8b0a-2cb3a0b4842e"}]': finished 2024-02-19T21:55:57.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:56.046462+0000 mon.smithi099 (mon.0) 452 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-02-19T21:55:57.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:56.046615+0000 mon.smithi099 (mon.0) 453 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:55:57.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:55:56.627715+0000 mon.smithi138 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.138:0/270906579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:55:58.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:55:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:56.340365+0000 mgr.smithi099.zfglya (mgr.14180) 158 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:55:58.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:55:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:56.340365+0000 mgr.smithi099.zfglya (mgr.14180) 158 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:00.346 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:55:58.340677+0000 mgr.smithi099.zfglya (mgr.14180) 159 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:00.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:55:58.340677+0000 mgr.smithi099.zfglya (mgr.14180) 159 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:02.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:00.341062+0000 mgr.smithi099.zfglya (mgr.14180) 160 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:02.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:00.341062+0000 mgr.smithi099.zfglya (mgr.14180) 160 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:03.258 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:02.442056+0000 mon.smithi099 (mon.0) 454 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T21:56:03.258 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:02.442863+0000 mon.smithi099 (mon.0) 455 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:03.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:02.442056+0000 mon.smithi099 (mon.0) 454 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T21:56:03.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:02.442863+0000 mon.smithi099 (mon.0) 455 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:04.386 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:02.341444+0000 mgr.smithi099.zfglya (mgr.14180) 161 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:04.386 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:56:02.443508+0000 mgr.smithi099.zfglya (mgr.14180) 162 : cephadm [INF] Deploying daemon osd.5 on smithi138 2024-02-19T21:56:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:02.341444+0000 mgr.smithi099.zfglya (mgr.14180) 161 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:56:02.443508+0000 mgr.smithi099.zfglya (mgr.14180) 162 : cephadm [INF] Deploying daemon osd.5 on smithi138 2024-02-19T21:56:06.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:04.341742+0000 mgr.smithi099.zfglya (mgr.14180) 163 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:06.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:04.341742+0000 mgr.smithi099.zfglya (mgr.14180) 163 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:08.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:06.342150+0000 mgr.smithi099.zfglya (mgr.14180) 164 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:08.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:08.062226+0000 mon.smithi099 (mon.0) 456 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:08.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:06.342150+0000 mgr.smithi099.zfglya (mgr.14180) 164 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:08.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:08.062226+0000 mon.smithi099 (mon.0) 456 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:09.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:08.080624+0000 mon.smithi099 (mon.0) 457 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:56:09.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:08.080624+0000 mon.smithi099 (mon.0) 457 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:56:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:08.342522+0000 mgr.smithi099.zfglya (mgr.14180) 165 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:10.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:08.342522+0000 mgr.smithi099.zfglya (mgr.14180) 165 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:11.739 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 5 on host 'smithi138' 2024-02-19T21:56:12.400 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:10.342939+0000 mgr.smithi099.zfglya (mgr.14180) 166 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:12.400 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:11.157943+0000 mon.smithi138 (mon.1) 8 : audit [INF] from='osd.5 [v2:172.21.15.138:6808/2231958133,v1:172.21.15.138:6809/2231958133]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T21:56:12.400 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:11.158691+0000 mon.smithi099 (mon.0) 458 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T21:56:12.400 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:11.739715+0000 mon.smithi099 (mon.0) 459 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:12.423 DEBUG:teuthology.orchestra.run.smithi138:osd.5> sudo journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.5.service 2024-02-19T21:56:12.426 INFO:tasks.cephadm:Deploying osd.6 on smithi138 with /dev/vg_nvme/lv_2... 2024-02-19T21:56:12.426 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-19T21:56:12.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:10.342939+0000 mgr.smithi099.zfglya (mgr.14180) 166 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:12.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:11.157943+0000 mon.smithi138 (mon.1) 8 : audit [INF] from='osd.5 [v2:172.21.15.138:6808/2231958133,v1:172.21.15.138:6809/2231958133]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T21:56:12.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:11.158691+0000 mon.smithi099 (mon.0) 458 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T21:56:12.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:11.739715+0000 mon.smithi099 (mon.0) 459 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:12.457 INFO:journalctl@ceph.osd.5.smithi138.stdout:-- Logs begin at Mon 2024-02-19 21:38:16 UTC. -- 2024-02-19T21:56:13.395 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 21:56:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T21:56:13.093+0000 7f11fdcf0700 -1 osd.5 0 waiting for initial osdmap 2024-02-19T21:56:13.395 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 21:56:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T21:56:13.098+0000 7f11f6c65700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:56:13.395 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:12.081305+0000 mon.smithi099 (mon.0) 460 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-19T21:56:13.395 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:12.081365+0000 mon.smithi099 (mon.0) 461 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-19T21:56:13.395 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:12.081752+0000 mon.smithi099 (mon.0) 462 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:56:13.395 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:12.082067+0000 mon.smithi138 (mon.1) 9 : audit [INF] from='osd.5 [v2:172.21.15.138:6808/2231958133,v1:172.21.15.138:6809/2231958133]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:56:13.396 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:12.084838+0000 mon.smithi099 (mon.0) 463 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:56:13.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:12.081305+0000 mon.smithi099 (mon.0) 460 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-19T21:56:13.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:12.081365+0000 mon.smithi099 (mon.0) 461 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-19T21:56:13.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:12.081752+0000 mon.smithi099 (mon.0) 462 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:56:13.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:12.082067+0000 mon.smithi138 (mon.1) 9 : audit [INF] from='osd.5 [v2:172.21.15.138:6808/2231958133,v1:172.21.15.138:6809/2231958133]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:56:13.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:12.084838+0000 mon.smithi099 (mon.0) 463 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:56:14.262 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:12.343311+0000 mgr.smithi099.zfglya (mgr.14180) 167 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:14.262 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:13.090369+0000 mon.smithi099 (mon.0) 464 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-19T21:56:14.263 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:13.090433+0000 mon.smithi099 (mon.0) 465 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-02-19T21:56:14.263 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:13.090731+0000 mon.smithi099 (mon.0) 466 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:56:14.263 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:13.095869+0000 mon.smithi099 (mon.0) 467 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:56:14.263 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:13.175603+0000 mon.smithi099 (mon.0) 468 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:14.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:12.343311+0000 mgr.smithi099.zfglya (mgr.14180) 167 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:14.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:13.090369+0000 mon.smithi099 (mon.0) 464 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-19T21:56:14.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:13.090433+0000 mon.smithi099 (mon.0) 465 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-02-19T21:56:14.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:13.090731+0000 mon.smithi099 (mon.0) 466 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:56:14.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:13.095869+0000 mon.smithi099 (mon.0) 467 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:56:14.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:13.175603+0000 mon.smithi099 (mon.0) 468 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:15.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:12.137268+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:15.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:12.137355+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:15.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:14.096650+0000 mon.smithi099 (mon.0) 469 : cluster [INF] osd.5 [v2:172.21.15.138:6808/2231958133,v1:172.21.15.138:6809/2231958133] boot 2024-02-19T21:56:15.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:14.096683+0000 mon.smithi099 (mon.0) 470 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-19T21:56:15.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:14.096846+0000 mon.smithi099 (mon.0) 471 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:56:15.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:14.774379+0000 mon.smithi099 (mon.0) 472 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-19T21:56:15.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:12.137268+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:15.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:12.137355+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:15.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:14.096650+0000 mon.smithi099 (mon.0) 469 : cluster [INF] osd.5 [v2:172.21.15.138:6808/2231958133,v1:172.21.15.138:6809/2231958133] boot 2024-02-19T21:56:15.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:14.096683+0000 mon.smithi099 (mon.0) 470 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-19T21:56:15.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:14.096846+0000 mon.smithi099 (mon.0) 471 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T21:56:15.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:14.774379+0000 mon.smithi099 (mon.0) 472 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-19T21:56:15.755 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-19T21:56:15.755 INFO:teuthology.orchestra.run.smithi138.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-19T21:56:15.755 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10+0 records in 2024-02-19T21:56:15.756 INFO:teuthology.orchestra.run.smithi138.stderr:10+0 records out 2024-02-19T21:56:15.756 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109019 s, 962 MB/s 2024-02-19T21:56:15.756 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping successful for: 2024-02-19T21:56:16.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:14.343656+0000 mgr.smithi099.zfglya (mgr.14180) 168 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:16.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:15.775634+0000 mon.smithi099 (mon.0) 473 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-02-19T21:56:16.498 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:14.343656+0000 mgr.smithi099.zfglya (mgr.14180) 168 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-19T21:56:16.498 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:15.775634+0000 mon.smithi099 (mon.0) 473 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-02-19T21:56:17.033 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi138:vg_nvme/lv_2 2024-02-19T21:56:18.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:16.343954+0000 mgr.smithi099.zfglya (mgr.14180) 169 : cluster [DBG] pgmap v144: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:18.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:16.343954+0000 mgr.smithi099.zfglya (mgr.14180) 169 : cluster [DBG] pgmap v144: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:18.344305+0000 mgr.smithi099.zfglya (mgr.14180) 170 : cluster [DBG] pgmap v145: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:19.689103+0000 mon.smithi099 (mon.0) 474 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:20.057733+0000 mon.smithi099 (mon.0) 475 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:56:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:20.058586+0000 mon.smithi099 (mon.0) 476 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:56:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:20.063801+0000 mon.smithi099 (mon.0) 477 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:20.064750+0000 mon.smithi099 (mon.0) 478 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:20.065493+0000 mon.smithi099 (mon.0) 479 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:56:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:20.070235+0000 mon.smithi099 (mon.0) 480 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:20.074384+0000 mon.smithi099 (mon.0) 481 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:56:20.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:20.075692+0000 mon.smithi099 (mon.0) 482 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:20.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:20.076370+0000 mon.smithi099 (mon.0) 483 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:56:20.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:20.082625+0000 mon.smithi099 (mon.0) 484 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:20.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:18.344305+0000 mgr.smithi099.zfglya (mgr.14180) 170 : cluster [DBG] pgmap v145: 1 pgs: 1 peering; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:20.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:19.689103+0000 mon.smithi099 (mon.0) 474 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:20.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:20.057733+0000 mon.smithi099 (mon.0) 475 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:56:20.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:20.058586+0000 mon.smithi099 (mon.0) 476 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:56:20.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:20.063801+0000 mon.smithi099 (mon.0) 477 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:20.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:20.064750+0000 mon.smithi099 (mon.0) 478 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:20.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:20.065493+0000 mon.smithi099 (mon.0) 479 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:56:20.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:20.070235+0000 mon.smithi099 (mon.0) 480 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:20.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:20.074384+0000 mon.smithi099 (mon.0) 481 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:56:20.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:20.075692+0000 mon.smithi099 (mon.0) 482 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:20.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:20.076370+0000 mon.smithi099 (mon.0) 483 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:56:20.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:20.082625+0000 mon.smithi099 (mon.0) 484 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:21.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:56:19.684037+0000 mgr.smithi099.zfglya (mgr.14180) 171 : cephadm [INF] Detected new or changed devices on smithi138 2024-02-19T21:56:21.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:56:20.059132+0000 mgr.smithi099.zfglya (mgr.14180) 172 : cephadm [INF] Adjusting osd_memory_target on smithi138 to 7985M 2024-02-19T21:56:21.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:20.125538+0000 mgr.smithi099.zfglya (mgr.14180) 173 : audit [DBG] from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:56:21.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:20.127746+0000 mon.smithi099 (mon.0) 485 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:56:21.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:20.129896+0000 mon.smithi099 (mon.0) 486 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:56:21.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:20.130601+0000 mon.smithi099 (mon.0) 487 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:21.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:56:19.684037+0000 mgr.smithi099.zfglya (mgr.14180) 171 : cephadm [INF] Detected new or changed devices on smithi138 2024-02-19T21:56:21.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:56:20.059132+0000 mgr.smithi099.zfglya (mgr.14180) 172 : cephadm [INF] Adjusting osd_memory_target on smithi138 to 7985M 2024-02-19T21:56:21.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:20.125538+0000 mgr.smithi099.zfglya (mgr.14180) 173 : audit [DBG] from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:56:21.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:20.127746+0000 mon.smithi099 (mon.0) 485 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:56:21.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:20.129896+0000 mon.smithi099 (mon.0) 486 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:56:21.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:20.130601+0000 mon.smithi099 (mon.0) 487 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:22.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:20.344657+0000 mgr.smithi099.zfglya (mgr.14180) 174 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:22.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:20.344657+0000 mgr.smithi099.zfglya (mgr.14180) 174 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:23.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:22.686859+0000 mon.smithi138 (mon.1) 10 : audit [INF] from='client.? 172.21.15.138:0/3889527671' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9bd96cc-87b6-4d3b-99e3-806ab0f6645e"}]: dispatch 2024-02-19T21:56:23.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:22.687533+0000 mon.smithi099 (mon.0) 488 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9bd96cc-87b6-4d3b-99e3-806ab0f6645e"}]: dispatch 2024-02-19T21:56:23.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:22.692328+0000 mon.smithi099 (mon.0) 489 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9bd96cc-87b6-4d3b-99e3-806ab0f6645e"}]': finished 2024-02-19T21:56:23.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:22.692395+0000 mon.smithi099 (mon.0) 490 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2024-02-19T21:56:23.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:22.692521+0000 mon.smithi099 (mon.0) 491 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:56:23.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:22.686859+0000 mon.smithi138 (mon.1) 10 : audit [INF] from='client.? 172.21.15.138:0/3889527671' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9bd96cc-87b6-4d3b-99e3-806ab0f6645e"}]: dispatch 2024-02-19T21:56:23.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:22.687533+0000 mon.smithi099 (mon.0) 488 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9bd96cc-87b6-4d3b-99e3-806ab0f6645e"}]: dispatch 2024-02-19T21:56:23.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:22.692328+0000 mon.smithi099 (mon.0) 489 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9bd96cc-87b6-4d3b-99e3-806ab0f6645e"}]': finished 2024-02-19T21:56:23.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:22.692395+0000 mon.smithi099 (mon.0) 490 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2024-02-19T21:56:23.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:22.692521+0000 mon.smithi099 (mon.0) 491 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:56:24.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:22.345110+0000 mgr.smithi099.zfglya (mgr.14180) 175 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:24.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:23.276297+0000 mon.smithi138 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.138:0/2685810029' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:56:24.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:22.345110+0000 mgr.smithi099.zfglya (mgr.14180) 175 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:24.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:23.276297+0000 mon.smithi138 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.138:0/2685810029' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:56:26.263 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:24.345594+0000 mgr.smithi099.zfglya (mgr.14180) 176 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:26.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:24.345594+0000 mgr.smithi099.zfglya (mgr.14180) 176 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:28.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:26.346078+0000 mgr.smithi099.zfglya (mgr.14180) 177 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:28.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:26.346078+0000 mgr.smithi099.zfglya (mgr.14180) 177 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:30.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:28.346469+0000 mgr.smithi099.zfglya (mgr.14180) 178 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:30.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:29.310208+0000 mon.smithi099 (mon.0) 492 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-19T21:56:30.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:29.311027+0000 mon.smithi099 (mon.0) 493 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:30.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:28.346469+0000 mgr.smithi099.zfglya (mgr.14180) 178 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:30.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:29.310208+0000 mon.smithi099 (mon.0) 492 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-19T21:56:30.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:29.311027+0000 mon.smithi099 (mon.0) 493 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:31.230 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:56:29.311807+0000 mgr.smithi099.zfglya (mgr.14180) 179 : cephadm [INF] Deploying daemon osd.6 on smithi138 2024-02-19T21:56:31.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:56:29.311807+0000 mgr.smithi099.zfglya (mgr.14180) 179 : cephadm [INF] Deploying daemon osd.6 on smithi138 2024-02-19T21:56:32.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:30.347021+0000 mgr.smithi099.zfglya (mgr.14180) 180 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:32.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:30.347021+0000 mgr.smithi099.zfglya (mgr.14180) 180 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:33.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:32.347365+0000 mgr.smithi099.zfglya (mgr.14180) 181 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:33.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:32.347365+0000 mgr.smithi099.zfglya (mgr.14180) 181 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:36.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:34.347781+0000 mgr.smithi099.zfglya (mgr.14180) 182 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:36.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:34.932648+0000 mon.smithi099 (mon.0) 494 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:36.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:34.940090+0000 mon.smithi099 (mon.0) 495 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:56:36.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:34.347781+0000 mgr.smithi099.zfglya (mgr.14180) 182 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:36.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:34.932648+0000 mon.smithi099 (mon.0) 494 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:36.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:34.940090+0000 mon.smithi099 (mon.0) 495 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:56:38.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:36.348333+0000 mgr.smithi099.zfglya (mgr.14180) 183 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:38.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:36.348333+0000 mgr.smithi099.zfglya (mgr.14180) 183 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:39.104 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 6 on host 'smithi138' 2024-02-19T21:56:39.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:38.002166+0000 mon.smithi138 (mon.1) 12 : audit [INF] from='osd.6 [v2:172.21.15.138:6816/2446479280,v1:172.21.15.138:6817/2446479280]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-19T21:56:39.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:38.002672+0000 mon.smithi099 (mon.0) 496 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-19T21:56:39.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:38.002166+0000 mon.smithi138 (mon.1) 12 : audit [INF] from='osd.6 [v2:172.21.15.138:6816/2446479280,v1:172.21.15.138:6817/2446479280]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-19T21:56:39.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:38.002672+0000 mon.smithi099 (mon.0) 496 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-19T21:56:39.796 DEBUG:teuthology.orchestra.run.smithi138:osd.6> sudo journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.6.service 2024-02-19T21:56:39.798 INFO:tasks.cephadm:Deploying osd.7 on smithi138 with /dev/vg_nvme/lv_1... 2024-02-19T21:56:39.799 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-19T21:56:39.829 INFO:journalctl@ceph.osd.6.smithi138.stdout:-- Logs begin at Mon 2024-02-19 21:38:16 UTC. -- 2024-02-19T21:56:39.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:38.348704+0000 mgr.smithi099.zfglya (mgr.14180) 184 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:39.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:38.942768+0000 mon.smithi099 (mon.0) 497 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-19T21:56:39.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:38.942822+0000 mon.smithi099 (mon.0) 498 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-02-19T21:56:39.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:38.942951+0000 mon.smithi099 (mon.0) 499 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:56:39.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:38.943225+0000 mon.smithi138 (mon.1) 13 : audit [INF] from='osd.6 [v2:172.21.15.138:6816/2446479280,v1:172.21.15.138:6817/2446479280]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:56:39.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:38.943579+0000 mon.smithi099 (mon.0) 500 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:56:39.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:39.104815+0000 mon.smithi099 (mon.0) 501 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:40.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:38.348704+0000 mgr.smithi099.zfglya (mgr.14180) 184 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:40.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:38.942768+0000 mon.smithi099 (mon.0) 497 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-19T21:56:40.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:38.942822+0000 mon.smithi099 (mon.0) 498 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-02-19T21:56:40.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:38.942951+0000 mon.smithi099 (mon.0) 499 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:56:40.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:38.943225+0000 mon.smithi138 (mon.1) 13 : audit [INF] from='osd.6 [v2:172.21.15.138:6816/2446479280,v1:172.21.15.138:6817/2446479280]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:56:40.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:38.943579+0000 mon.smithi099 (mon.0) 500 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:56:40.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:39.104815+0000 mon.smithi099 (mon.0) 501 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:40.041 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 21:56:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T21:56:39.950+0000 7fe013c3d700 -1 osd.6 0 waiting for initial osdmap 2024-02-19T21:56:40.041 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 21:56:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T21:56:39.956+0000 7fe0103b9700 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T21:56:41.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:39.946529+0000 mon.smithi099 (mon.0) 502 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-19T21:56:41.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:39.946619+0000 mon.smithi099 (mon.0) 503 : cluster [DBG] osdmap e42: 7 total, 6 up, 7 in 2024-02-19T21:56:41.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:39.947784+0000 mon.smithi099 (mon.0) 504 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:56:41.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:39.951752+0000 mon.smithi099 (mon.0) 505 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:56:41.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:39.955176+0000 mon.smithi099 (mon.0) 506 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:41.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:40.946340+0000 mon.smithi099 (mon.0) 507 : cluster [INF] osd.6 [v2:172.21.15.138:6816/2446479280,v1:172.21.15.138:6817/2446479280] boot 2024-02-19T21:56:41.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:40.946394+0000 mon.smithi099 (mon.0) 508 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-02-19T21:56:41.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:40.946562+0000 mon.smithi099 (mon.0) 509 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:56:41.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:39.946529+0000 mon.smithi099 (mon.0) 502 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-19T21:56:41.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:39.946619+0000 mon.smithi099 (mon.0) 503 : cluster [DBG] osdmap e42: 7 total, 6 up, 7 in 2024-02-19T21:56:41.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:39.947784+0000 mon.smithi099 (mon.0) 504 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:56:41.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:39.951752+0000 mon.smithi099 (mon.0) 505 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:56:41.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:39.955176+0000 mon.smithi099 (mon.0) 506 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:41.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:40.946340+0000 mon.smithi099 (mon.0) 507 : cluster [INF] osd.6 [v2:172.21.15.138:6816/2446479280,v1:172.21.15.138:6817/2446479280] boot 2024-02-19T21:56:41.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:40.946394+0000 mon.smithi099 (mon.0) 508 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-02-19T21:56:41.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:40.946562+0000 mon.smithi099 (mon.0) 509 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-19T21:56:42.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:38.951193+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:42.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:38.951229+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:42.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:40.349012+0000 mgr.smithi099.zfglya (mgr.14180) 185 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:42.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:41.947703+0000 mon.smithi099 (mon.0) 510 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-02-19T21:56:42.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:38.951193+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:56:42.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:38.951229+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:56:42.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:40.349012+0000 mgr.smithi099.zfglya (mgr.14180) 185 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-19T21:56:42.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:41.947703+0000 mon.smithi099 (mon.0) 510 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-02-19T21:56:43.759 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-19T21:56:43.759 INFO:teuthology.orchestra.run.smithi138.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-19T21:56:43.759 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10+0 records in 2024-02-19T21:56:43.759 INFO:teuthology.orchestra.run.smithi138.stderr:10+0 records out 2024-02-19T21:56:43.759 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113559 s, 923 MB/s 2024-02-19T21:56:43.759 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping successful for: 2024-02-19T21:56:44.119 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:42.349400+0000 mgr.smithi099.zfglya (mgr.14180) 186 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:44.119 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:42.951046+0000 mon.smithi099 (mon.0) 511 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2024-02-19T21:56:44.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:42.349400+0000 mgr.smithi099.zfglya (mgr.14180) 186 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:44.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:42.951046+0000 mon.smithi099 (mon.0) 511 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2024-02-19T21:56:44.774 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi138:vg_nvme/lv_1 2024-02-19T21:56:46.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:44.349691+0000 mgr.smithi099.zfglya (mgr.14180) 187 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:46.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:45.668485+0000 mon.smithi099 (mon.0) 512 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:46.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:45.669486+0000 mon.smithi099 (mon.0) 513 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:56:46.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:45.670274+0000 mon.smithi099 (mon.0) 514 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:56:46.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:45.670945+0000 mon.smithi099 (mon.0) 515 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:56:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:45.674971+0000 mon.smithi099 (mon.0) 516 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:45.675929+0000 mon.smithi099 (mon.0) 517 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:45.676652+0000 mon.smithi099 (mon.0) 518 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:56:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:45.680864+0000 mon.smithi099 (mon.0) 519 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:45.685199+0000 mon.smithi099 (mon.0) 520 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:56:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:45.686487+0000 mon.smithi099 (mon.0) 521 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:45.687098+0000 mon.smithi099 (mon.0) 522 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:56:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:45.691140+0000 mon.smithi099 (mon.0) 523 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:46.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:44.349691+0000 mgr.smithi099.zfglya (mgr.14180) 187 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:45.668485+0000 mon.smithi099 (mon.0) 512 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:45.669486+0000 mon.smithi099 (mon.0) 513 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:56:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:45.670274+0000 mon.smithi099 (mon.0) 514 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:56:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:45.670945+0000 mon.smithi099 (mon.0) 515 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:56:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:45.674971+0000 mon.smithi099 (mon.0) 516 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:45.675929+0000 mon.smithi099 (mon.0) 517 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:45.676652+0000 mon.smithi099 (mon.0) 518 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:56:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:45.680864+0000 mon.smithi099 (mon.0) 519 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:45.685199+0000 mon.smithi099 (mon.0) 520 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:56:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:45.686487+0000 mon.smithi099 (mon.0) 521 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:45.687098+0000 mon.smithi099 (mon.0) 522 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:56:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:45.691140+0000 mon.smithi099 (mon.0) 523 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:56:47.022 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:56:45.663047+0000 mgr.smithi099.zfglya (mgr.14180) 188 : cephadm [INF] Detected new or changed devices on smithi138 2024-02-19T21:56:47.022 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:56:45.671460+0000 mgr.smithi099.zfglya (mgr.14180) 189 : cephadm [INF] Adjusting osd_memory_target on smithi138 to 5323M 2024-02-19T21:56:47.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:56:45.663047+0000 mgr.smithi099.zfglya (mgr.14180) 188 : cephadm [INF] Detected new or changed devices on smithi138 2024-02-19T21:56:47.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:56:45.671460+0000 mgr.smithi099.zfglya (mgr.14180) 189 : cephadm [INF] Adjusting osd_memory_target on smithi138 to 5323M 2024-02-19T21:56:48.231 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:46.350054+0000 mgr.smithi099.zfglya (mgr.14180) 190 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:48.231 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:47.509747+0000 mon.smithi099 (mon.0) 524 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:56:48.231 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:47.512116+0000 mon.smithi099 (mon.0) 525 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:56:48.231 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:47.512791+0000 mon.smithi099 (mon.0) 526 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:48.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:46.350054+0000 mgr.smithi099.zfglya (mgr.14180) 190 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:48.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:47.509747+0000 mon.smithi099 (mon.0) 524 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T21:56:48.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:47.512116+0000 mon.smithi099 (mon.0) 525 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T21:56:48.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:47.512791+0000 mon.smithi099 (mon.0) 526 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:49.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:47.507269+0000 mgr.smithi099.zfglya (mgr.14180) 191 : audit [DBG] from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:56:49.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:47.507269+0000 mgr.smithi099.zfglya (mgr.14180) 191 : audit [DBG] from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:56:50.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:48.350588+0000 mgr.smithi099.zfglya (mgr.14180) 192 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:50.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:48.350588+0000 mgr.smithi099.zfglya (mgr.14180) 192 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:51.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:50.166297+0000 mon.smithi138 (mon.1) 14 : audit [INF] from='client.? 172.21.15.138:0/388078976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9433197d-4bc1-458f-8abd-7f3bc926475b"}]: dispatch 2024-02-19T21:56:51.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:50.166900+0000 mon.smithi099 (mon.0) 527 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9433197d-4bc1-458f-8abd-7f3bc926475b"}]: dispatch 2024-02-19T21:56:51.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:50.171652+0000 mon.smithi099 (mon.0) 528 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9433197d-4bc1-458f-8abd-7f3bc926475b"}]': finished 2024-02-19T21:56:51.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:50.171733+0000 mon.smithi099 (mon.0) 529 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2024-02-19T21:56:51.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:50.171859+0000 mon.smithi099 (mon.0) 530 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:56:51.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:50.824913+0000 mon.smithi138 (mon.1) 15 : audit [DBG] from='client.? 172.21.15.138:0/3366479591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:56:51.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:50.166297+0000 mon.smithi138 (mon.1) 14 : audit [INF] from='client.? 172.21.15.138:0/388078976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9433197d-4bc1-458f-8abd-7f3bc926475b"}]: dispatch 2024-02-19T21:56:51.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:50.166900+0000 mon.smithi099 (mon.0) 527 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9433197d-4bc1-458f-8abd-7f3bc926475b"}]: dispatch 2024-02-19T21:56:51.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:50.171652+0000 mon.smithi099 (mon.0) 528 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9433197d-4bc1-458f-8abd-7f3bc926475b"}]': finished 2024-02-19T21:56:51.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:50.171733+0000 mon.smithi099 (mon.0) 529 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2024-02-19T21:56:51.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:50.171859+0000 mon.smithi099 (mon.0) 530 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:56:51.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:50.824913+0000 mon.smithi138 (mon.1) 15 : audit [DBG] from='client.? 172.21.15.138:0/3366479591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T21:56:52.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:50.350983+0000 mgr.smithi099.zfglya (mgr.14180) 193 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:52.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:50.350983+0000 mgr.smithi099.zfglya (mgr.14180) 193 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:54.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:52.351351+0000 mgr.smithi099.zfglya (mgr.14180) 194 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:54.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:52.351351+0000 mgr.smithi099.zfglya (mgr.14180) 194 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:56.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:54.351703+0000 mgr.smithi099.zfglya (mgr.14180) 195 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:56.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:54.351703+0000 mgr.smithi099.zfglya (mgr.14180) 195 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:58.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:56.352036+0000 mgr.smithi099.zfglya (mgr.14180) 196 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:58.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:57.077931+0000 mon.smithi099 (mon.0) 531 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-19T21:56:58.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:56:57.078697+0000 mon.smithi099 (mon.0) 532 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:58.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:56:57.079387+0000 mgr.smithi099.zfglya (mgr.14180) 197 : cephadm [INF] Deploying daemon osd.7 on smithi138 2024-02-19T21:56:58.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:56.352036+0000 mgr.smithi099.zfglya (mgr.14180) 196 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:56:58.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:57.077931+0000 mon.smithi099 (mon.0) 531 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-19T21:56:58.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:56:57.078697+0000 mon.smithi099 (mon.0) 532 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:56:58.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:56:57.079387+0000 mgr.smithi099.zfglya (mgr.14180) 197 : cephadm [INF] Deploying daemon osd.7 on smithi138 2024-02-19T21:57:00.142 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:56:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:56:58.352545+0000 mgr.smithi099.zfglya (mgr.14180) 198 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:57:00.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:56:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:56:58.352545+0000 mgr.smithi099.zfglya (mgr.14180) 198 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:57:02.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:00.352960+0000 mgr.smithi099.zfglya (mgr.14180) 199 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:57:02.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:00.352960+0000 mgr.smithi099.zfglya (mgr.14180) 199 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:57:04.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:02.353489+0000 mgr.smithi099.zfglya (mgr.14180) 200 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:57:04.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:02.927683+0000 mon.smithi099 (mon.0) 533 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:57:04.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:02.950050+0000 mon.smithi099 (mon.0) 534 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:57:04.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:02.353489+0000 mgr.smithi099.zfglya (mgr.14180) 200 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:57:04.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:02.927683+0000 mon.smithi099 (mon.0) 533 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:57:04.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:02.950050+0000 mon.smithi099 (mon.0) 534 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:57:06.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:04.353776+0000 mgr.smithi099.zfglya (mgr.14180) 201 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:57:06.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:04.353776+0000 mgr.smithi099.zfglya (mgr.14180) 201 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:57:07.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:06.057815+0000 mon.smithi138 (mon.1) 16 : audit [INF] from='osd.7 [v2:172.21.15.138:6824/1656205368,v1:172.21.15.138:6825/1656205368]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-19T21:57:07.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:06.058335+0000 mon.smithi099 (mon.0) 535 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-19T21:57:07.124 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 7 on host 'smithi138' 2024-02-19T21:57:07.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:06.057815+0000 mon.smithi138 (mon.1) 16 : audit [INF] from='osd.7 [v2:172.21.15.138:6824/1656205368,v1:172.21.15.138:6825/1656205368]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-19T21:57:07.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:06.058335+0000 mon.smithi099 (mon.0) 535 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-19T21:57:07.936 DEBUG:teuthology.orchestra.run.smithi138:osd.7> sudo journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.7.service 2024-02-19T21:57:07.939 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-02-19T21:57:07.939 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph osd stat -f json 2024-02-19T21:57:07.970 INFO:journalctl@ceph.osd.7.smithi138.stdout:-- Logs begin at Mon 2024-02-19 21:38:16 UTC. -- 2024-02-19T21:57:08.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:06.354261+0000 mgr.smithi099.zfglya (mgr.14180) 202 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:57:08.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:06.939001+0000 mon.smithi099 (mon.0) 536 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-19T21:57:08.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:06.939064+0000 mon.smithi099 (mon.0) 537 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2024-02-19T21:57:08.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:06.939209+0000 mon.smithi099 (mon.0) 538 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:57:08.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:06.939585+0000 mon.smithi138 (mon.1) 17 : audit [INF] from='osd.7 [v2:172.21.15.138:6824/1656205368,v1:172.21.15.138:6825/1656205368]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:57:08.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:06.940124+0000 mon.smithi099 (mon.0) 539 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:57:08.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:07.124935+0000 mon.smithi099 (mon.0) 540 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:57:08.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:07.481229+0000 mon.smithi099 (mon.0) 541 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:57:08.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:06.354261+0000 mgr.smithi099.zfglya (mgr.14180) 202 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:57:08.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:06.939001+0000 mon.smithi099 (mon.0) 536 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-19T21:57:08.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:06.939064+0000 mon.smithi099 (mon.0) 537 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2024-02-19T21:57:08.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:06.939209+0000 mon.smithi099 (mon.0) 538 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:57:08.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:06.939585+0000 mon.smithi138 (mon.1) 17 : audit [INF] from='osd.7 [v2:172.21.15.138:6824/1656205368,v1:172.21.15.138:6825/1656205368]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:57:08.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:06.940124+0000 mon.smithi099 (mon.0) 539 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-19T21:57:08.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:07.124935+0000 mon.smithi099 (mon.0) 540 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:57:08.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:07.481229+0000 mon.smithi099 (mon.0) 541 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:57:08.947 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:07.939862+0000 mon.smithi099 (mon.0) 542 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-19T21:57:08.947 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:07.939962+0000 mon.smithi099 (mon.0) 543 : cluster [DBG] osdmap e48: 8 total, 7 up, 8 in 2024-02-19T21:57:08.947 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:07.940338+0000 mon.smithi099 (mon.0) 544 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:57:08.947 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:07.944427+0000 mon.smithi099 (mon.0) 545 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:57:09.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:07.939862+0000 mon.smithi099 (mon.0) 542 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-19T21:57:09.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:07.939962+0000 mon.smithi099 (mon.0) 543 : cluster [DBG] osdmap e48: 8 total, 7 up, 8 in 2024-02-19T21:57:09.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:07.940338+0000 mon.smithi099 (mon.0) 544 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:57:09.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:07.944427+0000 mon.smithi099 (mon.0) 545 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:57:09.947 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:57:10.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:07.011306+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:57:10.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:07.011355+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:57:10.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:08.354760+0000 mgr.smithi099.zfglya (mgr.14180) 203 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:57:10.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:08.945441+0000 mon.smithi099 (mon.0) 546 : cluster [INF] osd.7 [v2:172.21.15.138:6824/1656205368,v1:172.21.15.138:6825/1656205368] boot 2024-02-19T21:57:10.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:08.945542+0000 mon.smithi099 (mon.0) 547 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-02-19T21:57:10.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:08.945922+0000 mon.smithi099 (mon.0) 548 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:57:10.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:09.786800+0000 mon.smithi099 (mon.0) 549 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-19T21:57:10.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:07.011306+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-19T21:57:10.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:07.011355+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-19T21:57:10.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:08.354760+0000 mgr.smithi099.zfglya (mgr.14180) 203 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-19T21:57:10.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:08.945441+0000 mon.smithi099 (mon.0) 546 : cluster [INF] osd.7 [v2:172.21.15.138:6824/1656205368,v1:172.21.15.138:6825/1656205368] boot 2024-02-19T21:57:10.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:08.945542+0000 mon.smithi099 (mon.0) 547 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-02-19T21:57:10.242 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:08.945922+0000 mon.smithi099 (mon.0) 548 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-19T21:57:10.242 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:09.786800+0000 mon.smithi099 (mon.0) 549 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-19T21:57:10.640 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":50,"num_osds":8,"num_up_osds":8,"osd_up_since":1708379828,"num_in_osds":8,"osd_in_since":1708379810,"num_remapped_pgs":0} 2024-02-19T21:57:10.715 INFO:tasks.cephadm:Setting up client nodes... 2024-02-19T21:57:10.715 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-19T21:57:11.221 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:09.947810+0000 mon.smithi099 (mon.0) 550 : audit [DBG] from='client.? 172.21.15.99:0/393675449' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-19T21:57:11.221 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:10.788419+0000 mon.smithi099 (mon.0) 551 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-19T21:57:11.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:09.947810+0000 mon.smithi099 (mon.0) 550 : audit [DBG] from='client.? 172.21.15.99:0/393675449' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-19T21:57:11.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:10.788419+0000 mon.smithi099 (mon.0) 551 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-19T21:57:12.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:10.355060+0000 mgr.smithi099.zfglya (mgr.14180) 204 : cluster [DBG] pgmap v182: 1 pgs: 1 peering; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:12.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:11.176560+0000 mon.smithi099 (mon.0) 552 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:57:12.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:11.177383+0000 mon.smithi099 (mon.0) 553 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:57:12.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:11.177911+0000 mon.smithi099 (mon.0) 554 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:57:12.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:11.178400+0000 mon.smithi099 (mon.0) 555 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:57:12.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:11.178884+0000 mon.smithi099 (mon.0) 556 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:57:12.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:11.185442+0000 mon.smithi099 (mon.0) 557 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:57:12.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:11.186395+0000 mon.smithi099 (mon.0) 558 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:57:12.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:11.187085+0000 mon.smithi099 (mon.0) 559 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:57:12.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:11.193583+0000 mon.smithi099 (mon.0) 560 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:57:12.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:11.198671+0000 mon.smithi099 (mon.0) 561 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:57:12.075 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:11.199986+0000 mon.smithi099 (mon.0) 562 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:57:12.075 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:11.200535+0000 mon.smithi099 (mon.0) 563 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:57:12.075 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:11.206948+0000 mon.smithi099 (mon.0) 564 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:57:12.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:10.355060+0000 mgr.smithi099.zfglya (mgr.14180) 204 : cluster [DBG] pgmap v182: 1 pgs: 1 peering; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:12.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:11.176560+0000 mon.smithi099 (mon.0) 552 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:57:12.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:11.177383+0000 mon.smithi099 (mon.0) 553 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:57:12.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:11.177911+0000 mon.smithi099 (mon.0) 554 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:57:12.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:11.178400+0000 mon.smithi099 (mon.0) 555 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:57:12.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:11.178884+0000 mon.smithi099 (mon.0) 556 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-19T21:57:12.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:11.185442+0000 mon.smithi099 (mon.0) 557 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:57:12.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:11.186395+0000 mon.smithi099 (mon.0) 558 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:57:12.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:11.187085+0000 mon.smithi099 (mon.0) 559 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:57:12.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:11.193583+0000 mon.smithi099 (mon.0) 560 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:57:12.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:11.198671+0000 mon.smithi099 (mon.0) 561 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:57:12.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:11.199986+0000 mon.smithi099 (mon.0) 562 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:57:12.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:11.200535+0000 mon.smithi099 (mon.0) 563 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:57:12.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:11.206948+0000 mon.smithi099 (mon.0) 564 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:57:12.826 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-02-19T21:57:12.826 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQC4ztNlqj8YMRAAtWnPrVe2Xy/5i667NpiCBw== 2024-02-19T21:57:13.158 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:57:11.171937+0000 mgr.smithi099.zfglya (mgr.14180) 205 : cephadm [INF] Detected new or changed devices on smithi138 2024-02-19T21:57:13.158 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:57:11.179305+0000 mgr.smithi099.zfglya (mgr.14180) 206 : cephadm [INF] Adjusting osd_memory_target on smithi138 to 3992M 2024-02-19T21:57:13.158 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:12.823523+0000 mon.smithi099 (mon.0) 565 : audit [INF] from='client.? 172.21.15.99:0/3825869992' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:57:13.158 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:12.826957+0000 mon.smithi099 (mon.0) 566 : audit [INF] from='client.? 172.21.15.99:0/3825869992' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T21:57:13.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:57:11.171937+0000 mgr.smithi099.zfglya (mgr.14180) 205 : cephadm [INF] Detected new or changed devices on smithi138 2024-02-19T21:57:13.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:57:11.179305+0000 mgr.smithi099.zfglya (mgr.14180) 206 : cephadm [INF] Adjusting osd_memory_target on smithi138 to 3992M 2024-02-19T21:57:13.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:12.823523+0000 mon.smithi099 (mon.0) 565 : audit [INF] from='client.? 172.21.15.99:0/3825869992' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:57:13.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:12.826957+0000 mon.smithi099 (mon.0) 566 : audit [INF] from='client.? 172.21.15.99:0/3825869992' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T21:57:13.566 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:57:13.567 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-19T21:57:13.567 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-19T21:57:13.608 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-19T21:57:14.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:12.355411+0000 mgr.smithi099.zfglya (mgr.14180) 207 : cluster [DBG] pgmap v184: 1 pgs: 1 peering; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:14.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:12.355411+0000 mgr.smithi099.zfglya (mgr.14180) 207 : cluster [DBG] pgmap v184: 1 pgs: 1 peering; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:16.034 INFO:teuthology.orchestra.run.smithi138.stdout:[client.1] 2024-02-19T21:57:16.034 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQC8ztNlp/fFARAAUsCbJfRFmqUajtBupfB5nw== 2024-02-19T21:57:16.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:14.356023+0000 mgr.smithi099.zfglya (mgr.14180) 208 : cluster [DBG] pgmap v185: 1 pgs: 1 peering; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:16.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:14.356023+0000 mgr.smithi099.zfglya (mgr.14180) 208 : cluster [DBG] pgmap v185: 1 pgs: 1 peering; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:16.801 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-19T21:57:16.801 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-19T21:57:16.801 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-19T21:57:16.843 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-19T21:57:17.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:16.029036+0000 mon.smithi138 (mon.1) 18 : audit [INF] from='client.? 172.21.15.138:0/814940650' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:57:17.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:16.029554+0000 mon.smithi099 (mon.0) 567 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:57:17.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:16.035144+0000 mon.smithi099 (mon.0) 568 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T21:57:17.120 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:17.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:16.029036+0000 mon.smithi138 (mon.1) 18 : audit [INF] from='client.? 172.21.15.138:0/814940650' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:57:17.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:16.029554+0000 mon.smithi099 (mon.0) 567 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T21:57:17.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:16.035144+0000 mon.smithi099 (mon.0) 568 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T21:57:18.261 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:16.356483+0000 mgr.smithi099.zfglya (mgr.14180) 209 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:18.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:16.356483+0000 mgr.smithi099.zfglya (mgr.14180) 209 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:18.969 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:57:18.969 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":51,"fsid":"d4704266-cf70-11ee-95bb-87774f69a715","created":"2024-02-19T21:50:39.857499+0000","modified":"2024-02-19T21:57:10.783963+0000","last_up_change":"2024-02-19T21:57:08.941202+0000","last_in_change":"2024-02-19T21:56:50.167513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-19T21:54:54.711439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"e53b344b-7e5c-40ce-a9fb-75cabf0a2e38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6803","nonce":3368424446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6805","nonce":3368424446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6809","nonce":3368424446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6807","nonce":3368424446}]},"public_addr":"172.21.15.99:6803/3368424446","cluster_addr":"172.21.15.99:6805/3368424446","heartbeat_back_addr":"172.21.15.99:6809/3368424446","heartbeat_front_addr":"172.21.15.99:6807/3368424446","state":["exists","up"]},{"osd":1,"uuid":"ee0c10da-32d9-4965-b77c-3af025167ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6811","nonce":1906568453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6813","nonce":1906568453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6817","nonce":1906568453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6815","nonce":1906568453}]},"public_addr":"172.21.15.99:6811/1906568453","cluster_addr":"172.21.15.99:6813/1906568453","heartbeat_back_addr":"172.21.15.99:6817/1906568453","heartbeat_front_addr":"172.21.15.99:6815/1906568453","state":["exists","up"]},{"osd":2,"uuid":"6f71e815-b7bb-46f5-9a1b-1079a065be83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6819","nonce":2385653580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6821","nonce":2385653580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6825","nonce":2385653580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6823","nonce":2385653580}]},"public_addr":"172.21.15.99:6819/2385653580","cluster_addr":"172.21.15.99:6821/2385653580","heartbeat_back_addr":"172.21.15.99:6825/2385653580","heartbeat_front_addr":"172.21.15.99:6823/2385653580","state":["exists","up"]},{"osd":3,"uuid":"caf76464-0af6-40fa-b596-87796509feea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6827","nonce":2645326065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6829","nonce":2645326065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6833","nonce":2645326065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6831","nonce":2645326065}]},"public_addr":"172.21.15.99:6827/2645326065","cluster_addr":"172.21.15.99:6829/2645326065","heartbeat_back_addr":"172.21.15.99:6833/2645326065","heartbeat_front_addr":"172.21.15.99:6831/2645326065","state":["exists","up"]},{"osd":4,"uuid":"7440d499-f65f-4aab-94c1-2a282913ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6801","nonce":3461120502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6803","nonce":3461120502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6807","nonce":3461120502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6805","nonce":3461120502}]},"public_addr":"172.21.15.138:6801/3461120502","cluster_addr":"172.21.15.138:6803/3461120502","heartbeat_back_addr":"172.21.15.138:6807/3461120502","heartbeat_front_addr":"172.21.15.138:6805/3461120502","state":["exists","up"]},{"osd":5,"uuid":"6bf2ce61-d2cf-460a-8b0a-2cb3a0b4842e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6809","nonce":2231958133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6811","nonce":2231958133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6815","nonce":2231958133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6813","nonce":2231958133}]},"public_addr":"172.21.15.138:6809/2231958133","cluster_addr":"172.21.15.138:6811/2231958133","heartbeat_back_addr":"172.21.15.138:6815/2231958133","heartbeat_front_addr":"172.21.15.138:6813/2231958133","state":["exists","up"]},{"osd":6,"uuid":"c9bd96cc-87b6-4d3b-99e3-806ab0f6645e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6817","nonce":2446479280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6819","nonce":2446479280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6823","nonce":2446479280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6821","nonce":2446479280}]},"public_addr":"172.21.15.138:6817/2446479280","cluster_addr":"172.21.15.138:6819/2446479280","heartbeat_back_addr":"172.21.15.138:6823/2446479280","heartbeat_front_addr":"172.21.15.138:6821/2446479280","state":["exists","up"]},{"osd":7,"uuid":"9433197d-4bc1-458f-8abd-7f3bc926475b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6825","nonce":1656205368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6827","nonce":1656205368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6831","nonce":1656205368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6829","nonce":1656205368}]},"public_addr":"172.21.15.138:6825/1656205368","cluster_addr":"172.21.15.138:6827/1656205368","heartbeat_back_addr":"172.21.15.138:6831/1656205368","heartbeat_front_addr":"172.21.15.138:6829/1656205368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:53:59.171256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:26.362470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:52.547796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:20.628328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:44.993539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:12.137359+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:38.951231+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:57:07.011358+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6801/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6800/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1027099157":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6801/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:6800/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/2740163342":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/3517340242":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1183541513":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/957748873":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6800/3240823228":"2024-02-20T21:51:02.178299+0000","172.21.15.99:0/610705141":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6801/3240823228":"2024-02-20T21:51:02.178299+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T21:57:19.362 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:18.969467+0000 mon.smithi099 (mon.0) 569 : audit [DBG] from='client.? 172.21.15.99:0/2102580170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:57:19.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:18.969467+0000 mon.smithi099 (mon.0) 569 : audit [DBG] from='client.? 172.21.15.99:0/2102580170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:57:19.713 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-19T21:54:54.711439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2024-02-19T21:57:19.713 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph osd pool get device_health_metrics pg_num 2024-02-19T21:57:19.981 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:20.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:18.356944+0000 mgr.smithi099.zfglya (mgr.14180) 210 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:20.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:18.356944+0000 mgr.smithi099.zfglya (mgr.14180) 210 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:21.819 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-19T21:57:22.176 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:20.357325+0000 mgr.smithi099.zfglya (mgr.14180) 211 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:22.176 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:21.819570+0000 mon.smithi099 (mon.0) 570 : audit [DBG] from='client.? 172.21.15.99:0/1803473891' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-19T21:57:22.475 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-19T21:57:22.476 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-19T21:57:22.476 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph mgr dump --format=json 2024-02-19T21:57:22.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:20.357325+0000 mgr.smithi099.zfglya (mgr.14180) 211 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:22.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:21.819570+0000 mon.smithi099 (mon.0) 570 : audit [DBG] from='client.? 172.21.15.99:0/1803473891' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-19T21:57:22.744 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:24.254 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:22.357726+0000 mgr.smithi099.zfglya (mgr.14180) 212 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:24.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:22.357726+0000 mgr.smithi099.zfglya (mgr.14180) 212 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:24.722 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:57:25.353 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:24.718762+0000 mon.smithi099 (mon.0) 571 : audit [DBG] from='client.? 172.21.15.99:0/658035637' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-19T21:57:25.374 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":18,"active_gid":14180,"active_name":"smithi099.zfglya","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":826794125},{"type":"v1","addr":"172.21.15.99:6801","nonce":826794125}]},"active_addr":"172.21.15.99:6801/826794125","active_change":"2024-02-19T21:52:24.301215+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":14200,"name":"smithi138.yvypfr","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.99:8443/","prometheus":"http://172.21.15.99:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":4,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1729619452}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":3398972119}]}]} 2024-02-19T21:57:25.378 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-19T21:57:25.378 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-19T21:57:25.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-19T21:57:25.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:24.718762+0000 mon.smithi099 (mon.0) 571 : audit [DBG] from='client.? 172.21.15.99:0/658035637' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-19T21:57:25.648 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:26.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:24.358303+0000 mgr.smithi099.zfglya (mgr.14180) 213 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:26.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:24.358303+0000 mgr.smithi099.zfglya (mgr.14180) 213 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:27.598 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:57:27.598 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":51,"fsid":"d4704266-cf70-11ee-95bb-87774f69a715","created":"2024-02-19T21:50:39.857499+0000","modified":"2024-02-19T21:57:10.783963+0000","last_up_change":"2024-02-19T21:57:08.941202+0000","last_in_change":"2024-02-19T21:56:50.167513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-19T21:54:54.711439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"e53b344b-7e5c-40ce-a9fb-75cabf0a2e38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6803","nonce":3368424446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6805","nonce":3368424446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6809","nonce":3368424446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6807","nonce":3368424446}]},"public_addr":"172.21.15.99:6803/3368424446","cluster_addr":"172.21.15.99:6805/3368424446","heartbeat_back_addr":"172.21.15.99:6809/3368424446","heartbeat_front_addr":"172.21.15.99:6807/3368424446","state":["exists","up"]},{"osd":1,"uuid":"ee0c10da-32d9-4965-b77c-3af025167ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6811","nonce":1906568453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6813","nonce":1906568453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6817","nonce":1906568453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6815","nonce":1906568453}]},"public_addr":"172.21.15.99:6811/1906568453","cluster_addr":"172.21.15.99:6813/1906568453","heartbeat_back_addr":"172.21.15.99:6817/1906568453","heartbeat_front_addr":"172.21.15.99:6815/1906568453","state":["exists","up"]},{"osd":2,"uuid":"6f71e815-b7bb-46f5-9a1b-1079a065be83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6819","nonce":2385653580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6821","nonce":2385653580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6825","nonce":2385653580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6823","nonce":2385653580}]},"public_addr":"172.21.15.99:6819/2385653580","cluster_addr":"172.21.15.99:6821/2385653580","heartbeat_back_addr":"172.21.15.99:6825/2385653580","heartbeat_front_addr":"172.21.15.99:6823/2385653580","state":["exists","up"]},{"osd":3,"uuid":"caf76464-0af6-40fa-b596-87796509feea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6827","nonce":2645326065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6829","nonce":2645326065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6833","nonce":2645326065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6831","nonce":2645326065}]},"public_addr":"172.21.15.99:6827/2645326065","cluster_addr":"172.21.15.99:6829/2645326065","heartbeat_back_addr":"172.21.15.99:6833/2645326065","heartbeat_front_addr":"172.21.15.99:6831/2645326065","state":["exists","up"]},{"osd":4,"uuid":"7440d499-f65f-4aab-94c1-2a282913ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6801","nonce":3461120502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6803","nonce":3461120502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6807","nonce":3461120502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6805","nonce":3461120502}]},"public_addr":"172.21.15.138:6801/3461120502","cluster_addr":"172.21.15.138:6803/3461120502","heartbeat_back_addr":"172.21.15.138:6807/3461120502","heartbeat_front_addr":"172.21.15.138:6805/3461120502","state":["exists","up"]},{"osd":5,"uuid":"6bf2ce61-d2cf-460a-8b0a-2cb3a0b4842e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6809","nonce":2231958133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6811","nonce":2231958133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6815","nonce":2231958133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6813","nonce":2231958133}]},"public_addr":"172.21.15.138:6809/2231958133","cluster_addr":"172.21.15.138:6811/2231958133","heartbeat_back_addr":"172.21.15.138:6815/2231958133","heartbeat_front_addr":"172.21.15.138:6813/2231958133","state":["exists","up"]},{"osd":6,"uuid":"c9bd96cc-87b6-4d3b-99e3-806ab0f6645e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6817","nonce":2446479280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6819","nonce":2446479280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6823","nonce":2446479280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6821","nonce":2446479280}]},"public_addr":"172.21.15.138:6817/2446479280","cluster_addr":"172.21.15.138:6819/2446479280","heartbeat_back_addr":"172.21.15.138:6823/2446479280","heartbeat_front_addr":"172.21.15.138:6821/2446479280","state":["exists","up"]},{"osd":7,"uuid":"9433197d-4bc1-458f-8abd-7f3bc926475b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6825","nonce":1656205368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6827","nonce":1656205368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6831","nonce":1656205368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6829","nonce":1656205368}]},"public_addr":"172.21.15.138:6825/1656205368","cluster_addr":"172.21.15.138:6827/1656205368","heartbeat_back_addr":"172.21.15.138:6831/1656205368","heartbeat_front_addr":"172.21.15.138:6829/1656205368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:53:59.171256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:26.362470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:52.547796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:20.628328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:44.993539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:12.137359+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:38.951231+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:57:07.011358+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6801/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6800/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1027099157":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6801/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:6800/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/2740163342":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/3517340242":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1183541513":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/957748873":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6800/3240823228":"2024-02-20T21:51:02.178299+0000","172.21.15.99:0/610705141":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6801/3240823228":"2024-02-20T21:51:02.178299+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T21:57:28.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:26.358760+0000 mgr.smithi099.zfglya (mgr.14180) 214 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:28.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:27.598030+0000 mon.smithi099 (mon.0) 572 : audit [DBG] from='client.? 172.21.15.99:0/2986153840' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:57:28.277 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-19T21:57:28.277 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-19T21:57:28.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:26.358760+0000 mgr.smithi099.zfglya (mgr.14180) 214 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:28.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:27.598030+0000 mon.smithi099 (mon.0) 572 : audit [DBG] from='client.? 172.21.15.99:0/2986153840' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:57:28.543 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:30.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:28.359117+0000 mgr.smithi099.zfglya (mgr.14180) 215 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:30.266 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:57:30.266 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":51,"fsid":"d4704266-cf70-11ee-95bb-87774f69a715","created":"2024-02-19T21:50:39.857499+0000","modified":"2024-02-19T21:57:10.783963+0000","last_up_change":"2024-02-19T21:57:08.941202+0000","last_in_change":"2024-02-19T21:56:50.167513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-19T21:54:54.711439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"e53b344b-7e5c-40ce-a9fb-75cabf0a2e38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6803","nonce":3368424446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6805","nonce":3368424446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6809","nonce":3368424446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6807","nonce":3368424446}]},"public_addr":"172.21.15.99:6803/3368424446","cluster_addr":"172.21.15.99:6805/3368424446","heartbeat_back_addr":"172.21.15.99:6809/3368424446","heartbeat_front_addr":"172.21.15.99:6807/3368424446","state":["exists","up"]},{"osd":1,"uuid":"ee0c10da-32d9-4965-b77c-3af025167ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6811","nonce":1906568453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6813","nonce":1906568453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6817","nonce":1906568453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6815","nonce":1906568453}]},"public_addr":"172.21.15.99:6811/1906568453","cluster_addr":"172.21.15.99:6813/1906568453","heartbeat_back_addr":"172.21.15.99:6817/1906568453","heartbeat_front_addr":"172.21.15.99:6815/1906568453","state":["exists","up"]},{"osd":2,"uuid":"6f71e815-b7bb-46f5-9a1b-1079a065be83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6819","nonce":2385653580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6821","nonce":2385653580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6825","nonce":2385653580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6823","nonce":2385653580}]},"public_addr":"172.21.15.99:6819/2385653580","cluster_addr":"172.21.15.99:6821/2385653580","heartbeat_back_addr":"172.21.15.99:6825/2385653580","heartbeat_front_addr":"172.21.15.99:6823/2385653580","state":["exists","up"]},{"osd":3,"uuid":"caf76464-0af6-40fa-b596-87796509feea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6827","nonce":2645326065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6829","nonce":2645326065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6833","nonce":2645326065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6831","nonce":2645326065}]},"public_addr":"172.21.15.99:6827/2645326065","cluster_addr":"172.21.15.99:6829/2645326065","heartbeat_back_addr":"172.21.15.99:6833/2645326065","heartbeat_front_addr":"172.21.15.99:6831/2645326065","state":["exists","up"]},{"osd":4,"uuid":"7440d499-f65f-4aab-94c1-2a282913ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6801","nonce":3461120502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6803","nonce":3461120502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6807","nonce":3461120502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6805","nonce":3461120502}]},"public_addr":"172.21.15.138:6801/3461120502","cluster_addr":"172.21.15.138:6803/3461120502","heartbeat_back_addr":"172.21.15.138:6807/3461120502","heartbeat_front_addr":"172.21.15.138:6805/3461120502","state":["exists","up"]},{"osd":5,"uuid":"6bf2ce61-d2cf-460a-8b0a-2cb3a0b4842e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6809","nonce":2231958133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6811","nonce":2231958133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6815","nonce":2231958133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6813","nonce":2231958133}]},"public_addr":"172.21.15.138:6809/2231958133","cluster_addr":"172.21.15.138:6811/2231958133","heartbeat_back_addr":"172.21.15.138:6815/2231958133","heartbeat_front_addr":"172.21.15.138:6813/2231958133","state":["exists","up"]},{"osd":6,"uuid":"c9bd96cc-87b6-4d3b-99e3-806ab0f6645e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6817","nonce":2446479280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6819","nonce":2446479280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6823","nonce":2446479280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6821","nonce":2446479280}]},"public_addr":"172.21.15.138:6817/2446479280","cluster_addr":"172.21.15.138:6819/2446479280","heartbeat_back_addr":"172.21.15.138:6823/2446479280","heartbeat_front_addr":"172.21.15.138:6821/2446479280","state":["exists","up"]},{"osd":7,"uuid":"9433197d-4bc1-458f-8abd-7f3bc926475b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6825","nonce":1656205368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6827","nonce":1656205368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6831","nonce":1656205368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6829","nonce":1656205368}]},"public_addr":"172.21.15.138:6825/1656205368","cluster_addr":"172.21.15.138:6827/1656205368","heartbeat_back_addr":"172.21.15.138:6831/1656205368","heartbeat_front_addr":"172.21.15.138:6829/1656205368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:53:59.171256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:26.362470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:52.547796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:20.628328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:44.993539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:12.137359+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:38.951231+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:57:07.011358+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6801/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6800/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1027099157":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6801/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:6800/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/2740163342":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/3517340242":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1183541513":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/957748873":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6800/3240823228":"2024-02-20T21:51:02.178299+0000","172.21.15.99:0/610705141":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6801/3240823228":"2024-02-20T21:51:02.178299+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T21:57:30.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:28.359117+0000 mgr.smithi099.zfglya (mgr.14180) 215 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:30.940 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-19T21:57:31.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:30.266899+0000 mon.smithi099 (mon.0) 573 : audit [DBG] from='client.? 172.21.15.99:0/1134582574' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:57:31.210 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:31.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:30.266899+0000 mon.smithi099 (mon.0) 573 : audit [DBG] from='client.? 172.21.15.99:0/1134582574' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:57:32.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:30.359443+0000 mgr.smithi099.zfglya (mgr.14180) 216 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:32.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:30.359443+0000 mgr.smithi099.zfglya (mgr.14180) 216 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:33.561 INFO:teuthology.orchestra.run.smithi099.stdout:38654705710 2024-02-19T21:57:33.562 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-19T21:57:33.828 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:34.442 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:32.359804+0000 mgr.smithi099.zfglya (mgr.14180) 217 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:34.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:32.359804+0000 mgr.smithi099.zfglya (mgr.14180) 217 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:36.189 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:34.360176+0000 mgr.smithi099.zfglya (mgr.14180) 218 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:36.208 INFO:teuthology.orchestra.run.smithi099.stdout:60129542184 2024-02-19T21:57:36.209 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-19T21:57:36.474 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:36.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:34.360176+0000 mgr.smithi099.zfglya (mgr.14180) 218 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:38.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:36.360488+0000 mgr.smithi099.zfglya (mgr.14180) 219 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:38.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:36.360488+0000 mgr.smithi099.zfglya (mgr.14180) 219 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:39.007 INFO:teuthology.orchestra.run.smithi099.stdout:81604378660 2024-02-19T21:57:39.008 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-19T21:57:39.277 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:40.435 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:38.360932+0000 mgr.smithi099.zfglya (mgr.14180) 220 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:40.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:38.360932+0000 mgr.smithi099.zfglya (mgr.14180) 220 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:41.669 INFO:teuthology.orchestra.run.smithi099.stdout:111669149727 2024-02-19T21:57:41.669 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-19T21:57:41.936 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:42.402 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:40.361249+0000 mgr.smithi099.zfglya (mgr.14180) 221 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:42.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:40.361249+0000 mgr.smithi099.zfglya (mgr.14180) 221 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:44.270 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:42.361562+0000 mgr.smithi099.zfglya (mgr.14180) 222 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:44.290 INFO:teuthology.orchestra.run.smithi099.stdout:133143986202 2024-02-19T21:57:44.290 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-19T21:57:44.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:42.361562+0000 mgr.smithi099.zfglya (mgr.14180) 222 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:44.558 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:46.214 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:44.361888+0000 mgr.smithi099.zfglya (mgr.14180) 223 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:46.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:44.361888+0000 mgr.smithi099.zfglya (mgr.14180) 223 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:46.870 INFO:teuthology.orchestra.run.smithi099.stdout:158913789974 2024-02-19T21:57:46.871 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-02-19T21:57:47.136 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:48.331 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:46.362392+0000 mgr.smithi099.zfglya (mgr.14180) 224 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:48.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:46.362392+0000 mgr.smithi099.zfglya (mgr.14180) 224 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:49.450 INFO:teuthology.orchestra.run.smithi099.stdout:184683593744 2024-02-19T21:57:49.451 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-02-19T21:57:49.719 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:50.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:48.362661+0000 mgr.smithi099.zfglya (mgr.14180) 225 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:50.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:48.362661+0000 mgr.smithi099.zfglya (mgr.14180) 225 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:51.904 INFO:teuthology.orchestra.run.smithi099.stdout:210453397514 2024-02-19T21:57:51.905 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-19T21:57:52.174 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:52.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:50.362938+0000 mgr.smithi099.zfglya (mgr.14180) 226 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:52.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:50.362938+0000 mgr.smithi099.zfglya (mgr.14180) 226 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:54.044 INFO:teuthology.orchestra.run.smithi099.stdout:38654705714 2024-02-19T21:57:54.409 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:52.363262+0000 mgr.smithi099.zfglya (mgr.14180) 227 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:54.409 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:54.045102+0000 mon.smithi099 (mon.0) 574 : audit [DBG] from='client.? 172.21.15.99:0/2177487362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-19T21:57:54.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:52.363262+0000 mgr.smithi099.zfglya (mgr.14180) 227 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:54.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:54.045102+0000 mon.smithi099 (mon.0) 574 : audit [DBG] from='client.? 172.21.15.99:0/2177487362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-19T21:57:54.727 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705710 got 38654705714 for osd.0 2024-02-19T21:57:54.727 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-19T21:57:54.995 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:56.436 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:54.363522+0000 mgr.smithi099.zfglya (mgr.14180) 228 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:56.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:54.363522+0000 mgr.smithi099.zfglya (mgr.14180) 228 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:56.848 INFO:teuthology.orchestra.run.smithi099.stdout:60129542188 2024-02-19T21:57:57.197 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:56.850047+0000 mon.smithi099 (mon.0) 575 : audit [DBG] from='client.? 172.21.15.99:0/3712919406' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-19T21:57:57.507 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542184 got 60129542188 for osd.1 2024-02-19T21:57:57.507 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-19T21:57:57.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:56.850047+0000 mon.smithi099 (mon.0) 575 : audit [DBG] from='client.? 172.21.15.99:0/3712919406' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-19T21:57:57.775 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:57:58.228 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:57:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:56.363968+0000 mgr.smithi099.zfglya (mgr.14180) 229 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:58.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:57:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:56.363968+0000 mgr.smithi099.zfglya (mgr.14180) 229 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:57:59.500 INFO:teuthology.orchestra.run.smithi099.stdout:81604378664 2024-02-19T21:58:00.161 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378660 got 81604378664 for osd.2 2024-02-19T21:58:00.161 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-19T21:58:00.428 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:58:00.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:57:58.364436+0000 mgr.smithi099.zfglya (mgr.14180) 230 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:00.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:57:59.501514+0000 mon.smithi099 (mon.0) 576 : audit [DBG] from='client.? 172.21.15.99:0/2882041620' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-19T21:58:00.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:57:58.364436+0000 mgr.smithi099.zfglya (mgr.14180) 230 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:00.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:57:59.501514+0000 mon.smithi099 (mon.0) 576 : audit [DBG] from='client.? 172.21.15.99:0/2882041620' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-19T21:58:02.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:00.364762+0000 mgr.smithi099.zfglya (mgr.14180) 231 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:02.286 INFO:teuthology.orchestra.run.smithi099.stdout:111669149731 2024-02-19T21:58:02.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:00.364762+0000 mgr.smithi099.zfglya (mgr.14180) 231 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:02.965 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149727 got 111669149731 for osd.3 2024-02-19T21:58:02.965 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-19T21:58:03.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:02.287904+0000 mon.smithi099 (mon.0) 577 : audit [DBG] from='client.? 172.21.15.99:0/3235417730' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-19T21:58:03.232 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:58:03.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:02.287904+0000 mon.smithi099 (mon.0) 577 : audit [DBG] from='client.? 172.21.15.99:0/3235417730' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-19T21:58:04.370 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:02.365209+0000 mgr.smithi099.zfglya (mgr.14180) 232 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:04.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:02.365209+0000 mgr.smithi099.zfglya (mgr.14180) 232 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:05.020 INFO:teuthology.orchestra.run.smithi099.stdout:133143986206 2024-02-19T21:58:05.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:05.020862+0000 mon.smithi099 (mon.0) 578 : audit [DBG] from='client.? 172.21.15.99:0/3752505034' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-19T21:58:05.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:05.020862+0000 mon.smithi099 (mon.0) 578 : audit [DBG] from='client.? 172.21.15.99:0/3752505034' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-19T21:58:05.673 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986202 got 133143986206 for osd.4 2024-02-19T21:58:05.673 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-19T21:58:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:58:06.406 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:04.365501+0000 mgr.smithi099.zfglya (mgr.14180) 233 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:06.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:04.365501+0000 mgr.smithi099.zfglya (mgr.14180) 233 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:07.729 INFO:teuthology.orchestra.run.smithi099.stdout:158913789978 2024-02-19T21:58:08.326 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:06.365815+0000 mgr.smithi099.zfglya (mgr.14180) 234 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:08.327 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:07.730192+0000 mon.smithi099 (mon.0) 579 : audit [DBG] from='client.? 172.21.15.99:0/1621935203' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-19T21:58:08.346 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789974 got 158913789978 for osd.5 2024-02-19T21:58:08.346 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-02-19T21:58:08.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:06.365815+0000 mgr.smithi099.zfglya (mgr.14180) 234 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:08.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:07.730192+0000 mon.smithi099 (mon.0) 579 : audit [DBG] from='client.? 172.21.15.99:0/1621935203' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-19T21:58:08.615 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:58:10.162 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:08.366108+0000 mgr.smithi099.zfglya (mgr.14180) 235 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:10.521 INFO:teuthology.orchestra.run.smithi099.stdout:184683593748 2024-02-19T21:58:10.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:08.366108+0000 mgr.smithi099.zfglya (mgr.14180) 235 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:11.152 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593744 got 184683593748 for osd.6 2024-02-19T21:58:11.152 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-02-19T21:58:11.431 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:58:11.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:10.522935+0000 mon.smithi099 (mon.0) 580 : audit [DBG] from='client.? 172.21.15.99:0/1974358347' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-19T21:58:11.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:10.522935+0000 mon.smithi099 (mon.0) 580 : audit [DBG] from='client.? 172.21.15.99:0/1974358347' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-19T21:58:12.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:10.366435+0000 mgr.smithi099.zfglya (mgr.14180) 236 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:12.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:11.211425+0000 mon.smithi099 (mon.0) 581 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:58:12.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:11.513011+0000 mon.smithi099 (mon.0) 582 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:12.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:11.513712+0000 mon.smithi099 (mon.0) 583 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:58:12.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:11.517688+0000 mon.smithi099 (mon.0) 584 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:12.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:10.366435+0000 mgr.smithi099.zfglya (mgr.14180) 236 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:12.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:11.211425+0000 mon.smithi099 (mon.0) 581 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:58:12.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:11.513011+0000 mon.smithi099 (mon.0) 582 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:12.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:11.513712+0000 mon.smithi099 (mon.0) 583 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:58:12.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:11.517688+0000 mon.smithi099 (mon.0) 584 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:13.258 INFO:teuthology.orchestra.run.smithi099.stdout:210453397518 2024-02-19T21:58:13.940 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397514 got 210453397518 for osd.7 2024-02-19T21:58:13.940 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-19T21:58:13.940 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:58:14.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:12.366751+0000 mgr.smithi099.zfglya (mgr.14180) 237 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:14.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:13.258904+0000 mon.smithi099 (mon.0) 585 : audit [DBG] from='client.? 172.21.15.99:0/3664685373' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-19T21:58:14.208 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:58:14.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:12.366751+0000 mgr.smithi099.zfglya (mgr.14180) 237 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:14.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:13.258904+0000 mon.smithi099 (mon.0) 585 : audit [DBG] from='client.? 172.21.15.99:0/3664685373' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-19T21:58:15.974 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:58:15.975 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-02-19T21:58:16.313 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:14.367207+0000 mgr.smithi099.zfglya (mgr.14180) 238 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:16.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:14.367207+0000 mgr.smithi099.zfglya (mgr.14180) 238 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:16.608 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-02-19T21:58:14.366986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":2380696,"kb_used_data":3928,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":747580520,"statfs":{"total":767960285184,"available":765522452480,"internally_reserved":0,"allocated":4022272,"data_stored":1607050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-19T21:57:10.905829+0000","last_change":"2024-02-19T21:57:10.905829+0000","last_active":"2024-02-19T21:57:10.905829+0000","last_peered":"2024-02-19T21:57:10.905829+0000","last_clean":"2024-02-19T21:57:10.905829+0000","last_became_active":"2024-02-19T21:57:10.905408+0000","last_became_peered":"2024-02-19T21:57:10.905408+0000","last_unstale":"2024-02-19T21:57:10.905829+0000","last_undegraded":"2024-02-19T21:57:10.905829+0000","last_fullsized":"2024-02-19T21:57:10.905829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:55.464927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:55.464927+0000","last_clean_scrub_stamp":"2024-02-19T21:54:55.464927+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":49,"seq":210453397518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297588,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447564,"statfs":{"total":95995035648,"available":95690305536,"internally_reserved":0,"allocated":503808,"data_stored":200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.46300000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.49399999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.64500000000000002}]},{"osd":3,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.52600000000000002}]},{"osd":4,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.60199999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.57899999999999996}]},{"osd":6,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.51400000000000001}]}]},{"osd":6,"up_from":43,"seq":184683593749,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297584,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447568,"statfs":{"total":95995035648,"available":95690309632,"internally_reserved":0,"allocated":499712,"data_stored":200645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:57:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.50900000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:57:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.42899999999999999}]},{"osd":2,"last update":"Mon Feb 19 21:57:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.47699999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:57:42 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.58299999999999996}]},{"osd":4,"last update":"Mon Feb 19 21:57:42 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.38100000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:57:42 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":14,"seq":60129542192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297588,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447564,"statfs":{"total":95995035648,"available":95690305536,"internally_reserved":0,"allocated":503808,"data_stored":200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:57:32 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.33000000000000002,"15min":0.314},"min":{"1min":0.25,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.45600000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.35999999999999999,"15min":0.33800000000000002},"min":{"1min":0.26300000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.44}]},{"osd":2,"last update":"Mon Feb 19 21:58:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.371,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46000000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38600000000000001,"15min":0.377},"min":{"1min":0.27600000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.50900000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.376}]},{"osd":3,"last update":"Mon Feb 19 21:57:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.433,"15min":0.42999999999999999},"min":{"1min":0.33000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.43099999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:57:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.47999999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.72799999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.755},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.48599999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.78300000000000003,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.76300000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:57:14 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.80200000000000005}]},{"osd":6,"last update":"Mon Feb 19 21:57:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.68200000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297588,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447564,"statfs":{"total":95995035648,"available":95690305536,"internally_reserved":0,"allocated":503808,"data_stored":200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.33700000000000002,"15min":0.31},"min":{"1min":0.28499999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.313},"min":{"1min":0.23200000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55400000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.33400000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:58:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.27300000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.246,"5min":0.223,"15min":0.223},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.31}]},{"osd":3,"last update":"Mon Feb 19 21:57:30 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44,"15min":0.441},"min":{"1min":0.32500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.55700000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.437,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.36199999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:57:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.437,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58199999999999996}]},{"osd":5,"last update":"Mon Feb 19 21:57:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Feb 19 21:57:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297588,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447564,"statfs":{"total":95995035648,"available":95690305536,"internally_reserved":0,"allocated":503808,"data_stored":200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:58:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.49099999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53800000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.247}]},{"osd":1,"last update":"Mon Feb 19 21:58:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.47699999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.252,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54500000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.34699999999999998}]},{"osd":3,"last update":"Mon Feb 19 21:57:29 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.47999999999999998,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.58299999999999996,"5min":0.626,"15min":0.626},"last":0.29699999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.39000000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.54300000000000004,"15min":0.52700000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.504}]},{"osd":5,"last update":"Mon Feb 19 21:57:15 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.53700000000000003}]},{"osd":6,"last update":"Mon Feb 19 21:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57099999999999995}]},{"osd":7,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.49399999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149734,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297588,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447564,"statfs":{"total":95995035648,"available":95690305536,"internally_reserved":0,"allocated":503808,"data_stored":200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:57:27 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39500000000000002,"15min":0.39600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.27200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.26200000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:57:27 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42099999999999999,"15min":0.42199999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40600000000000003,"15min":0.40400000000000003},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.314}]},{"osd":2,"last update":"Mon Feb 19 21:57:27 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.432,"15min":0.433},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.34999999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78900000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45100000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:57:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.47199999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:57:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.55000000000000004}]},{"osd":7,"last update":"Mon Feb 19 21:58:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.48699999999999999}]}]},{"osd":4,"up_from":31,"seq":133143986208,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297588,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447564,"statfs":{"total":95995035648,"available":95690305536,"internally_reserved":0,"allocated":503808,"data_stored":200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.71799999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.442},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58499999999999996,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72899999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.47899999999999998}]},{"osd":1,"last update":"Mon Feb 19 21:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54500000000000004,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76500000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.63200000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72999999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76100000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54100000000000004}]},{"osd":3,"last update":"Mon Feb 19 21:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77700000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73699999999999999,"5min":0.754,"15min":0.754},"last":0.56100000000000005}]},{"osd":5,"last update":"Mon Feb 19 21:57:16 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.64900000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:57:45 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.66800000000000004}]},{"osd":7,"last update":"Mon Feb 19 21:58:11 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.71399999999999997}]}]},{"osd":5,"up_from":37,"seq":158913789979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297584,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447568,"statfs":{"total":95995035648,"available":95690309632,"internally_reserved":0,"allocated":499712,"data_stored":200645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:57:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Feb 19 21:57:17 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.434},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.58199999999999996}]},{"osd":2,"last update":"Mon Feb 19 21:57:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.55200000000000005}]},{"osd":3,"last update":"Mon Feb 19 21:57:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.59799999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:57:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:58:16.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T21:58:16.876 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:58:17.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:15.972225+0000 mgr.smithi099.zfglya (mgr.14180) 239 : audit [DBG] from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:58:17.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:15.972225+0000 mgr.smithi099.zfglya (mgr.14180) 239 : audit [DBG] from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:58:18.368 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:16.367590+0000 mgr.smithi099.zfglya (mgr.14180) 240 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:18.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:16.367590+0000 mgr.smithi099.zfglya (mgr.14180) 240 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:18.786 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:58:18.788 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-02-19T21:58:19.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:18.367919+0000 mgr.smithi099.zfglya (mgr.14180) 241 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:19.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:18.784653+0000 mgr.smithi099.zfglya (mgr.14180) 242 : audit [DBG] from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:58:19.469 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-02-19T21:58:18.367779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":2380696,"kb_used_data":3928,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":747580520,"statfs":{"total":767960285184,"available":765522452480,"internally_reserved":0,"allocated":4022272,"data_stored":1607050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-19T21:57:10.905829+0000","last_change":"2024-02-19T21:57:10.905829+0000","last_active":"2024-02-19T21:57:10.905829+0000","last_peered":"2024-02-19T21:57:10.905829+0000","last_clean":"2024-02-19T21:57:10.905829+0000","last_became_active":"2024-02-19T21:57:10.905408+0000","last_became_peered":"2024-02-19T21:57:10.905408+0000","last_unstale":"2024-02-19T21:57:10.905829+0000","last_undegraded":"2024-02-19T21:57:10.905829+0000","last_fullsized":"2024-02-19T21:57:10.905829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T21:54:55.464927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T21:54:55.464927+0000","last_clean_scrub_stamp":"2024-02-19T21:54:55.464927+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":49,"seq":210453397519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297588,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447564,"statfs":{"total":95995035648,"available":95690305536,"internally_reserved":0,"allocated":503808,"data_stored":200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.57199999999999995}]},{"osd":1,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.59499999999999997}]},{"osd":2,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.44500000000000001}]},{"osd":3,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.434}]},{"osd":4,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.372},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.55700000000000005}]},{"osd":6,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.51800000000000002}]}]},{"osd":6,"up_from":43,"seq":184683593750,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297584,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447568,"statfs":{"total":95995035648,"available":95690309632,"internally_reserved":0,"allocated":499712,"data_stored":200645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:57:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.56399999999999995}]},{"osd":1,"last update":"Mon Feb 19 21:57:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.64200000000000002}]},{"osd":2,"last update":"Mon Feb 19 21:57:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.58999999999999997}]},{"osd":3,"last update":"Mon Feb 19 21:57:42 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.57399999999999995}]},{"osd":4,"last update":"Mon Feb 19 21:57:42 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.41799999999999998}]},{"osd":5,"last update":"Mon Feb 19 21:57:42 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.434},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.48899999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:58:11 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.50800000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297588,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447564,"statfs":{"total":95995035648,"available":95690305536,"internally_reserved":0,"allocated":503808,"data_stored":200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:57:32 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.33000000000000002,"15min":0.314},"min":{"1min":0.25,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.45600000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.35999999999999999,"15min":0.33800000000000002},"min":{"1min":0.26300000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.44}]},{"osd":2,"last update":"Mon Feb 19 21:58:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.371,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46000000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38600000000000001,"15min":0.377},"min":{"1min":0.27600000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.50900000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.376}]},{"osd":3,"last update":"Mon Feb 19 21:57:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.433,"15min":0.42999999999999999},"min":{"1min":0.33000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.43099999999999999}]},{"osd":4,"last update":"Mon Feb 19 21:57:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.47999999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.72799999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.755},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.48599999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.78300000000000003,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.76300000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:57:14 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.80200000000000005}]},{"osd":6,"last update":"Mon Feb 19 21:57:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.68200000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297588,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447564,"statfs":{"total":95995035648,"available":95690305536,"internally_reserved":0,"allocated":503808,"data_stored":200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 21:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.33700000000000002,"15min":0.31},"min":{"1min":0.28499999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.313},"min":{"1min":0.23200000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55400000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.317}]},{"osd":2,"last update":"Mon Feb 19 21:58:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.27300000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.38500000000000001,"15min":0.375},"min":{"1min":0.246,"5min":0.223,"15min":0.223},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.30399999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:57:30 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44,"15min":0.441},"min":{"1min":0.32500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.55700000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.375},{"interface":"front","average":{"1min":0.437,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.34399999999999997}]},{"osd":4,"last update":"Mon Feb 19 21:57:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.437,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64100000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:57:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Feb 19 21:57:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.627},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Feb 19 21:58:12 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58599999999999997}]}]},{"osd":2,"up_from":19,"seq":81604378668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297588,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447564,"statfs":{"total":95995035648,"available":95690305536,"internally_reserved":0,"allocated":503808,"data_stored":200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:58:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.49099999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53800000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.32100000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:58:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.47699999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.252,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54500000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.30499999999999999}]},{"osd":3,"last update":"Mon Feb 19 21:57:29 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.47999999999999998,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.58299999999999996,"5min":0.626,"15min":0.626},"last":0.34300000000000003}]},{"osd":4,"last update":"Mon Feb 19 21:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.52700000000000002,"15min":0.51300000000000001},"min":{"1min":0.39000000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.54300000000000004,"15min":0.52700000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.622}]},{"osd":5,"last update":"Mon Feb 19 21:57:15 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.56799999999999995}]},{"osd":6,"last update":"Mon Feb 19 21:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57599999999999996}]},{"osd":7,"last update":"Mon Feb 19 21:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.68200000000000005}]}]},{"osd":3,"up_from":26,"seq":111669149734,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297588,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447564,"statfs":{"total":95995035648,"available":95690305536,"internally_reserved":0,"allocated":503808,"data_stored":200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:57:27 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39500000000000002,"15min":0.39600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.27200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.26200000000000001}]},{"osd":1,"last update":"Mon Feb 19 21:57:27 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42099999999999999,"15min":0.42199999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.40600000000000003,"15min":0.40400000000000003},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.314}]},{"osd":2,"last update":"Mon Feb 19 21:57:27 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45900000000000002,"15min":0.46000000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.432,"15min":0.433},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.34999999999999998}]},{"osd":4,"last update":"Mon Feb 19 21:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78900000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45100000000000001}]},{"osd":5,"last update":"Mon Feb 19 21:57:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.47199999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:57:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.55000000000000004}]},{"osd":7,"last update":"Mon Feb 19 21:58:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.48699999999999999}]}]},{"osd":4,"up_from":31,"seq":133143986209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297588,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447564,"statfs":{"total":95995035648,"available":95690305536,"internally_reserved":0,"allocated":503808,"data_stored":200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.71799999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58499999999999996,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72899999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.628}]},{"osd":1,"last update":"Mon Feb 19 21:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54500000000000004,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76500000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.44700000000000001}]},{"osd":2,"last update":"Mon Feb 19 21:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72999999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76100000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58799999999999997}]},{"osd":3,"last update":"Mon Feb 19 21:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77700000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73699999999999999,"5min":0.754,"15min":0.754},"last":0.61399999999999999}]},{"osd":5,"last update":"Mon Feb 19 21:57:16 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.37},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.64000000000000001}]},{"osd":6,"last update":"Mon Feb 19 21:57:45 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.65500000000000003}]},{"osd":7,"last update":"Mon Feb 19 21:58:11 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.56200000000000006}]}]},{"osd":5,"up_from":37,"seq":158913789980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297584,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447568,"statfs":{"total":95995035648,"available":95690309632,"internally_reserved":0,"allocated":499712,"data_stored":200645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 21:57:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.53700000000000003}]},{"osd":1,"last update":"Mon Feb 19 21:57:17 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.65700000000000003}]},{"osd":2,"last update":"Mon Feb 19 21:57:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.71799999999999997}]},{"osd":3,"last update":"Mon Feb 19 21:57:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.626},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.69899999999999995}]},{"osd":4,"last update":"Mon Feb 19 21:57:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.72399999999999998}]},{"osd":6,"last update":"Mon Feb 19 21:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.56899999999999995}]},{"osd":7,"last update":"Mon Feb 19 21:58:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.59799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T21:58:19.471 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-19T21:58:19.471 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-19T21:58:19.471 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-19T21:58:19.471 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- ceph health --format=json 2024-02-19T21:58:19.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:18.367919+0000 mgr.smithi099.zfglya (mgr.14180) 241 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:19.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:18.784653+0000 mgr.smithi099.zfglya (mgr.14180) 242 : audit [DBG] from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T21:58:19.741 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/mon.smithi099/config 2024-02-19T21:58:21.653 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:58:21.677 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:20.368205+0000 mgr.smithi099.zfglya (mgr.14180) 243 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:21.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:20.368205+0000 mgr.smithi099.zfglya (mgr.14180) 243 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:22.376 INFO:teuthology.orchestra.run.smithi099.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-19T21:58:22.377 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-19T21:58:22.377 INFO:tasks.cephadm:Setup complete, yielding 2024-02-19T21:58:22.377 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T21:58:22.386 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi099.front.sepia.ceph.com 2024-02-19T21:58:22.387 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- bash -c 'ceph orch status' 2024-02-19T21:58:22.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:21.654361+0000 mon.smithi099 (mon.0) 586 : audit [DBG] from='client.? 172.21.15.99:0/3566438599' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-19T21:58:22.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:21.654361+0000 mon.smithi099 (mon.0) 586 : audit [DBG] from='client.? 172.21.15.99:0/3566438599' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-19T21:58:23.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:22.368503+0000 mgr.smithi099.zfglya (mgr.14180) 244 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:23.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:22.368503+0000 mgr.smithi099.zfglya (mgr.14180) 244 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:24.543 INFO:teuthology.orchestra.run.smithi099.stdout:Backend: cephadm 2024-02-19T21:58:24.544 INFO:teuthology.orchestra.run.smithi099.stdout:Available: Yes 2024-02-19T21:58:24.544 INFO:teuthology.orchestra.run.smithi099.stdout:Paused: No 2024-02-19T21:58:25.276 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-19T21:58:25.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:24.368791+0000 mgr.smithi099.zfglya (mgr.14180) 245 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:25.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:24.544464+0000 mgr.smithi099.zfglya (mgr.14180) 246 : audit [DBG] from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:58:25.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:24.368791+0000 mgr.smithi099.zfglya (mgr.14180) 245 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:25.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:24.544464+0000 mgr.smithi099.zfglya (mgr.14180) 246 : audit [DBG] from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:58:27.390 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T21:58:27.390 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (4m) 3m ago 6m 23.4M - 0.23.0 ba2b418f427c f1536a62280a 2024-02-19T21:58:27.390 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (6m) 3m ago 6m 6639k - 16.2.14-548-g81bd20d6 823b921721f5 52c84cf97e3d 2024-02-19T21:58:27.390 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi138 smithi138 running (5m) 79s ago 5m 6635k - 16.2.14-548-g81bd20d6 823b921721f5 34fd9fdc2901 2024-02-19T21:58:27.390 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (4m) 3m ago 6m 41.7M - 8.3.5 dad864ee21e9 2a61f1c13204 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.zfglya smithi099 *:9283 running (7m) 3m ago 7m 429M - 16.2.14-548-g81bd20d6 823b921721f5 fc6c1f20226f 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi138.yvypfr smithi138 *:8443,9283 running (5m) 79s ago 5m 386M - 16.2.14-548-g81bd20d6 823b921721f5 de8413d714f3 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (7m) 3m ago 7m 54.6M 2048M 16.2.14-548-g81bd20d6 823b921721f5 6d9ffe0655ab 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi138 smithi138 running (5m) 79s ago 5m 57.6M 2048M 16.2.14-548-g81bd20d6 823b921721f5 91eae1efe255 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (6m) 3m ago 6m 23.0M - 1.3.1 1dbe0e931976 58b16421a2e4 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi138 smithi138 *:9100 running (5m) 79s ago 5m 22.1M - 1.3.1 1dbe0e931976 c20cc5ea1199 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (4m) 3m ago 4m 28.2M 3224M 16.2.14-548-g81bd20d6 823b921721f5 f4d4d499eead 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (4m) 3m ago 4m 27.2M 3224M 16.2.14-548-g81bd20d6 823b921721f5 4abfc3f61f15 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (3m) 3m ago 3m 26.2M 3224M 16.2.14-548-g81bd20d6 823b921721f5 f4e8c10c09db 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (3m) 3m ago 3m 10.4M 3224M 16.2.14-548-g81bd20d6 823b921721f5 38fcbd9774e0 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi138 running (2m) 79s ago 2m 28.9M 3992M 16.2.14-548-g81bd20d6 823b921721f5 345853810e10 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi138 running (2m) 79s ago 2m 30.3M 3992M 16.2.14-548-g81bd20d6 823b921721f5 537021d8d26e 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi138 running (113s) 79s ago 112s 27.2M 3992M 16.2.14-548-g81bd20d6 823b921721f5 6fbefe3b6c51 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi138 running (85s) 79s ago 84s 12.8M 3992M 16.2.14-548-g81bd20d6 823b921721f5 12df0127ec9f 2024-02-19T21:58:27.391 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (4m) 3m ago 5m 44.3M - 2.33.4 514e6a882f6e a12a0e625d16 2024-02-19T21:58:27.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:26.369160+0000 mgr.smithi099.zfglya (mgr.14180) 247 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:27.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:26.369160+0000 mgr.smithi099.zfglya (mgr.14180) 247 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:28.113 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-19T21:58:28.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:27.383372+0000 mgr.smithi099.zfglya (mgr.14180) 248 : audit [DBG] from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:58:28.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:27.383372+0000 mgr.smithi099.zfglya (mgr.14180) 248 : audit [DBG] from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:58:29.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:28.369446+0000 mgr.smithi099.zfglya (mgr.14180) 249 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:29.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:28.369446+0000 mgr.smithi099.zfglya (mgr.14180) 249 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:30.281 INFO:teuthology.orchestra.run.smithi099.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-19T21:58:30.281 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager ?:9093,9094 1/1 3m ago 7m count:1 2024-02-19T21:58:30.281 INFO:teuthology.orchestra.run.smithi099.stdout:crash 2/2 3m ago 7m * 2024-02-19T21:58:30.281 INFO:teuthology.orchestra.run.smithi099.stdout:grafana ?:3000 1/1 3m ago 7m count:1 2024-02-19T21:58:30.281 INFO:teuthology.orchestra.run.smithi099.stdout:mgr 2/2 3m ago 7m count:2 2024-02-19T21:58:30.282 INFO:teuthology.orchestra.run.smithi099.stdout:mon 2/2 3m ago 5m smithi099:172.21.15.99=smithi099;smithi138:172.21.15.138=smithi138;count:2 2024-02-19T21:58:30.282 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter ?:9100 2/2 3m ago 7m * 2024-02-19T21:58:30.282 INFO:teuthology.orchestra.run.smithi099.stdout:osd 8 3m ago - 2024-02-19T21:58:30.282 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus ?:9095 1/1 3m ago 7m count:1 2024-02-19T21:58:31.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-19T21:58:31.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:30.278587+0000 mgr.smithi099.zfglya (mgr.14180) 250 : audit [DBG] from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:58:31.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:30.369878+0000 mgr.smithi099.zfglya (mgr.14180) 251 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:31.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:30.278587+0000 mgr.smithi099.zfglya (mgr.14180) 250 : audit [DBG] from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:58:31.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:30.369878+0000 mgr.smithi099.zfglya (mgr.14180) 251 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:33.161 INFO:teuthology.orchestra.run.smithi099.stdout:HOST ADDR LABELS STATUS 2024-02-19T21:58:33.161 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099 172.21.15.99 2024-02-19T21:58:33.162 INFO:teuthology.orchestra.run.smithi099.stdout:smithi138 172.21.15.138 2024-02-19T21:58:33.162 INFO:teuthology.orchestra.run.smithi099.stdout:2 hosts in cluster 2024-02-19T21:58:33.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:32.370273+0000 mgr.smithi099.zfglya (mgr.14180) 252 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:33.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:32.370273+0000 mgr.smithi099.zfglya (mgr.14180) 252 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:33.895 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-19T21:58:34.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:33.161353+0000 mgr.smithi099.zfglya (mgr.14180) 253 : audit [DBG] from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:58:34.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:33.161353+0000 mgr.smithi099.zfglya (mgr.14180) 253 : audit [DBG] from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:58:35.581 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:34.370559+0000 mgr.smithi099.zfglya (mgr.14180) 254 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:35.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:34.370559+0000 mgr.smithi099.zfglya (mgr.14180) 254 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:35.949 INFO:teuthology.orchestra.run.smithi099.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-02-19T21:58:35.949 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099 /dev/nvme0n1 ssd INTEL SSDPEDMD400G4_PHFT62040101400BGN 372G 3m ago Has a FileSystem, LVM detected 2024-02-19T21:58:35.949 INFO:teuthology.orchestra.run.smithi099.stdout:smithi138 /dev/nvme0n1 ssd INTEL SSDPEDMD400G4_CVFT6161003C400BGN 372G 84s ago Has a FileSystem, LVM detected 2024-02-19T21:58:36.666 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:35.949872+0000 mgr.smithi099.zfglya (mgr.14180) 255 : audit [DBG] from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:58:36.689 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T21:58:36.698 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi099.front.sepia.ceph.com 2024-02-19T21:58:36.698 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- bash -c 'ceph fs volume create foo' 2024-02-19T21:58:36.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:35.949872+0000 mgr.smithi099.zfglya (mgr.14180) 255 : audit [DBG] from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:58:37.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:36.370907+0000 mgr.smithi099.zfglya (mgr.14180) 256 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:37.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:36.370907+0000 mgr.smithi099.zfglya (mgr.14180) 256 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:39.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:38.371231+0000 mgr.smithi099.zfglya (mgr.14180) 257 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:39.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:38.829975+0000 mgr.smithi099.zfglya (mgr.14180) 258 : audit [DBG] from='client.14458 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "foo", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:58:39.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:38.830515+0000 mon.smithi099 (mon.0) 587 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]: dispatch 2024-02-19T21:58:39.951 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:38.371231+0000 mgr.smithi099.zfglya (mgr.14180) 257 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:39.951 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:38.829975+0000 mgr.smithi099.zfglya (mgr.14180) 258 : audit [DBG] from='client.14458 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "foo", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:58:39.952 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:38.830515+0000 mon.smithi099 (mon.0) 587 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]: dispatch 2024-02-19T21:58:40.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:39.471110+0000 mon.smithi099 (mon.0) 588 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]': finished 2024-02-19T21:58:40.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:39.471157+0000 mon.smithi099 (mon.0) 589 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-19T21:58:40.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:39.472616+0000 mon.smithi099 (mon.0) 590 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]: dispatch 2024-02-19T21:58:40.856 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:39.471110+0000 mon.smithi099 (mon.0) 588 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]': finished 2024-02-19T21:58:40.857 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:39.471157+0000 mon.smithi099 (mon.0) 589 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-19T21:58:40.857 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:39.472616+0000 mon.smithi099 (mon.0) 590 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]: dispatch 2024-02-19T21:58:40.857 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T21:58:40.480+0000 7f81975f7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T21:58:41.249 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4704266-cf70-11ee-95bb-87774f69a715 -- bash -c 'ceph fs volume create bar' 2024-02-19T21:58:41.551 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:40.371583+0000 mgr.smithi099.zfglya (mgr.14180) 259 : cluster [DBG] pgmap v229: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:41.552 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:40.477864+0000 mon.smithi099 (mon.0) 591 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]': finished 2024-02-19T21:58:41.552 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:40.478096+0000 mon.smithi099 (mon.0) 592 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-19T21:58:41.552 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:40.481314+0000 mon.smithi099 (mon.0) 593 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]: dispatch 2024-02-19T21:58:41.552 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:40.482134+0000 mon.smithi099 (mon.0) 594 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T21:58:41.552 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:40.482162+0000 mon.smithi099 (mon.0) 595 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-19T21:58:41.552 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:40.493536+0000 mon.smithi099 (mon.0) 596 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-19T21:58:41.552 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:40.494388+0000 mon.smithi099 (mon.0) 597 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]': finished 2024-02-19T21:58:41.552 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:40.494496+0000 mon.smithi099 (mon.0) 598 : cluster [DBG] fsmap foo:0 2024-02-19T21:58:41.552 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:58:40.498155+0000 mgr.smithi099.zfglya (mgr.14180) 260 : cephadm [INF] Saving service mds.foo spec with placement count:2 2024-02-19T21:58:41.552 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:40.501843+0000 mon.smithi099 (mon.0) 599 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:41.552 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:40.546212+0000 mon.smithi099 (mon.0) 600 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:58:41.553 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:40.547594+0000 mon.smithi099 (mon.0) 601 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:41.553 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:40.548139+0000 mon.smithi099 (mon.0) 602 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:58:41.553 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:40.552093+0000 mon.smithi099 (mon.0) 603 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:41.553 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:40.558013+0000 mon.smithi099 (mon.0) 604 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:41.553 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:40.558690+0000 mon.smithi099 (mon.0) 605 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foo.smithi099.berqpt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T21:58:41.553 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:40.561232+0000 mon.smithi099 (mon.0) 606 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.smithi099.berqpt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T21:58:41.553 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:40.562320+0000 mon.smithi099 (mon.0) 607 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:41.553 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:58:40.564078+0000 mgr.smithi099.zfglya (mgr.14180) 261 : cephadm [INF] Deploying daemon mds.foo.smithi099.berqpt on smithi099 2024-02-19T21:58:41.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:40.371583+0000 mgr.smithi099.zfglya (mgr.14180) 259 : cluster [DBG] pgmap v229: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:41.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:40.477864+0000 mon.smithi099 (mon.0) 591 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]': finished 2024-02-19T21:58:41.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:40.478096+0000 mon.smithi099 (mon.0) 592 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-19T21:58:41.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:40.481314+0000 mon.smithi099 (mon.0) 593 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]: dispatch 2024-02-19T21:58:41.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:40.482134+0000 mon.smithi099 (mon.0) 594 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T21:58:41.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:40.482162+0000 mon.smithi099 (mon.0) 595 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-19T21:58:41.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:40.493536+0000 mon.smithi099 (mon.0) 596 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-19T21:58:41.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:40.494388+0000 mon.smithi099 (mon.0) 597 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]': finished 2024-02-19T21:58:41.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:40.494496+0000 mon.smithi099 (mon.0) 598 : cluster [DBG] fsmap foo:0 2024-02-19T21:58:41.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:58:40.498155+0000 mgr.smithi099.zfglya (mgr.14180) 260 : cephadm [INF] Saving service mds.foo spec with placement count:2 2024-02-19T21:58:41.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:40.501843+0000 mon.smithi099 (mon.0) 599 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:41.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:40.546212+0000 mon.smithi099 (mon.0) 600 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:58:41.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:40.547594+0000 mon.smithi099 (mon.0) 601 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:41.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:40.548139+0000 mon.smithi099 (mon.0) 602 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:58:41.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:40.552093+0000 mon.smithi099 (mon.0) 603 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:41.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:40.558013+0000 mon.smithi099 (mon.0) 604 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:41.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:40.558690+0000 mon.smithi099 (mon.0) 605 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foo.smithi099.berqpt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T21:58:41.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:40.561232+0000 mon.smithi099 (mon.0) 606 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.smithi099.berqpt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T21:58:41.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:40.562320+0000 mon.smithi099 (mon.0) 607 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:41.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:58:40.564078+0000 mgr.smithi099.zfglya (mgr.14180) 261 : cephadm [INF] Deploying daemon mds.foo.smithi099.berqpt on smithi099 2024-02-19T21:58:42.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:41.492626+0000 mon.smithi099 (mon.0) 608 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-19T21:58:42.911 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:41.492626+0000 mon.smithi099 (mon.0) 608 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-19T21:58:43.603 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:42.371955+0000 mgr.smithi099.zfglya (mgr.14180) 262 : cluster [DBG] pgmap v233: 65 pgs: 2 creating+activating, 15 creating+peering, 29 unknown, 19 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:43.603 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:42.502531+0000 mon.smithi099 (mon.0) 609 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-19T21:58:43.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:42.371955+0000 mgr.smithi099.zfglya (mgr.14180) 262 : cluster [DBG] pgmap v233: 65 pgs: 2 creating+activating, 15 creating+peering, 29 unknown, 19 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:43.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:42.502531+0000 mon.smithi099 (mon.0) 609 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-19T21:58:44.932 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:44.357251+0000 mon.smithi099 (mon.0) 610 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pool create", "pool": "cephfs.bar.meta"}]: dispatch 2024-02-19T21:58:45.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:44.357251+0000 mon.smithi099 (mon.0) 610 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pool create", "pool": "cephfs.bar.meta"}]: dispatch 2024-02-19T21:58:46.058 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:44.356764+0000 mgr.smithi099.zfglya (mgr.14180) 263 : audit [DBG] from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "bar", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:58:46.058 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:44.372655+0000 mgr.smithi099.zfglya (mgr.14180) 264 : cluster [DBG] pgmap v235: 65 pgs: 2 creating+activating, 15 creating+peering, 11 unknown, 37 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:46.058 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:44.651744+0000 mon.smithi099 (mon.0) 611 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pool create", "pool": "cephfs.bar.meta"}]': finished 2024-02-19T21:58:46.058 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:44.651785+0000 mon.smithi099 (mon.0) 612 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-19T21:58:46.058 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:44.652914+0000 mon.smithi099 (mon.0) 613 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"}]: dispatch 2024-02-19T21:58:46.058 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:44.899190+0000 mon.smithi099 (mon.0) 614 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:46.058 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:44.900207+0000 mon.smithi099 (mon.0) 615 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foo.smithi138.lynaor", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T21:58:46.058 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:44.906258+0000 mon.smithi099 (mon.0) 616 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.smithi138.lynaor", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T21:58:46.058 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:44.906820+0000 mon.smithi099 (mon.0) 617 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:46.058 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:58:44.907306+0000 mgr.smithi099.zfglya (mgr.14180) 265 : cephadm [INF] Deploying daemon mds.foo.smithi138.lynaor on smithi138 2024-02-19T21:58:46.059 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:45.654150+0000 mon.smithi099 (mon.0) 618 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"}]': finished 2024-02-19T21:58:46.059 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:45.654392+0000 mon.smithi099 (mon.0) 619 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-19T21:58:46.059 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:45.666638+0000 mon.smithi099 (mon.0) 620 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"}]: dispatch 2024-02-19T21:58:46.059 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:45.667367+0000 mon.smithi099 (mon.0) 621 : cluster [INF] daemon mds.foo.smithi099.berqpt assigned to filesystem bar as rank 0 2024-02-19T21:58:46.059 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:45.679451+0000 mon.smithi099 (mon.0) 622 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-19T21:58:46.059 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:45.679783+0000 mon.smithi099 (mon.0) 623 : cluster [DBG] mds.? [v2:172.21.15.99:6834/1068101591,v1:172.21.15.99:6835/1068101591] up:boot 2024-02-19T21:58:46.059 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:45.679852+0000 mon.smithi099 (mon.0) 624 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"}]': finished 2024-02-19T21:58:46.059 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:45.679925+0000 mon.smithi099 (mon.0) 625 : cluster [DBG] fsmap foo:0 bar:1 {bar:0=foo.smithi099.berqpt=up:creating} 2024-02-19T21:58:46.059 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:45.680342+0000 mon.smithi099 (mon.0) 626 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mds metadata", "who": "foo.smithi099.berqpt"}]: dispatch 2024-02-19T21:58:46.059 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:45.687131+0000 mon.smithi099 (mon.0) 627 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:46.059 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:45.699671+0000 mon.smithi099 (mon.0) 628 : cluster [INF] daemon mds.foo.smithi099.berqpt is now active in filesystem bar as rank 0 2024-02-19T21:58:46.155 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:44.356764+0000 mgr.smithi099.zfglya (mgr.14180) 263 : audit [DBG] from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "bar", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T21:58:46.156 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:44.372655+0000 mgr.smithi099.zfglya (mgr.14180) 264 : cluster [DBG] pgmap v235: 65 pgs: 2 creating+activating, 15 creating+peering, 11 unknown, 37 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:46.156 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:44.651744+0000 mon.smithi099 (mon.0) 611 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pool create", "pool": "cephfs.bar.meta"}]': finished 2024-02-19T21:58:46.156 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:44.651785+0000 mon.smithi099 (mon.0) 612 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-19T21:58:46.156 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:44.652914+0000 mon.smithi099 (mon.0) 613 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"}]: dispatch 2024-02-19T21:58:46.156 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:44.899190+0000 mon.smithi099 (mon.0) 614 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:46.157 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:44.900207+0000 mon.smithi099 (mon.0) 615 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foo.smithi138.lynaor", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T21:58:46.157 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:44.906258+0000 mon.smithi099 (mon.0) 616 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.smithi138.lynaor", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T21:58:46.157 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:44.906820+0000 mon.smithi099 (mon.0) 617 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:46.157 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:58:44.907306+0000 mgr.smithi099.zfglya (mgr.14180) 265 : cephadm [INF] Deploying daemon mds.foo.smithi138.lynaor on smithi138 2024-02-19T21:58:46.157 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:45.654150+0000 mon.smithi099 (mon.0) 618 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"}]': finished 2024-02-19T21:58:46.157 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:45.654392+0000 mon.smithi099 (mon.0) 619 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-19T21:58:46.158 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:45.666638+0000 mon.smithi099 (mon.0) 620 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"}]: dispatch 2024-02-19T21:58:46.158 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:45.667367+0000 mon.smithi099 (mon.0) 621 : cluster [INF] daemon mds.foo.smithi099.berqpt assigned to filesystem bar as rank 0 2024-02-19T21:58:46.158 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:45.679451+0000 mon.smithi099 (mon.0) 622 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-19T21:58:46.158 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:45.679783+0000 mon.smithi099 (mon.0) 623 : cluster [DBG] mds.? [v2:172.21.15.99:6834/1068101591,v1:172.21.15.99:6835/1068101591] up:boot 2024-02-19T21:58:46.158 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:45.679852+0000 mon.smithi099 (mon.0) 624 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"}]': finished 2024-02-19T21:58:46.158 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:45.679925+0000 mon.smithi099 (mon.0) 625 : cluster [DBG] fsmap foo:0 bar:1 {bar:0=foo.smithi099.berqpt=up:creating} 2024-02-19T21:58:46.158 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:45.680342+0000 mon.smithi099 (mon.0) 626 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mds metadata", "who": "foo.smithi099.berqpt"}]: dispatch 2024-02-19T21:58:46.159 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:45.687131+0000 mon.smithi099 (mon.0) 627 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:46.159 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:45.699671+0000 mon.smithi099 (mon.0) 628 : cluster [INF] daemon mds.foo.smithi099.berqpt is now active in filesystem bar as rank 0 2024-02-19T21:58:46.488 INFO:teuthology.run_tasks:Running task fs.ready... 2024-02-19T21:58:46.503 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T21:58:46.898 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:58:46.898 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":60,"fsid":"d4704266-cf70-11ee-95bb-87774f69a715","created":"2024-02-19T21:50:39.857499+0000","modified":"2024-02-19T21:58:46.674597+0000","last_up_change":"2024-02-19T21:57:08.941202+0000","last_in_change":"2024-02-19T21:56:50.167513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-19T21:54:54.711439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.foo.meta","create_time":"2024-02-19T21:58:39.068104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"foo"}}},{"pool":3,"pool_name":"cephfs.foo.data","create_time":"2024-02-19T21:58:39.705512+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"foo"}}},{"pool":4,"pool_name":"cephfs.bar.meta","create_time":"2024-02-19T21:58:44.596747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"bar"}}},{"pool":5,"pool_name":"cephfs.bar.data","create_time":"2024-02-19T21:58:44.891087+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"bar"}}}],"osds":[{"osd":0,"uuid":"e53b344b-7e5c-40ce-a9fb-75cabf0a2e38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6803","nonce":3368424446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6805","nonce":3368424446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6809","nonce":3368424446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6807","nonce":3368424446}]},"public_addr":"172.21.15.99:6803/3368424446","cluster_addr":"172.21.15.99:6805/3368424446","heartbeat_back_addr":"172.21.15.99:6809/3368424446","heartbeat_front_addr":"172.21.15.99:6807/3368424446","state":["exists","up"]},{"osd":1,"uuid":"ee0c10da-32d9-4965-b77c-3af025167ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6811","nonce":1906568453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6813","nonce":1906568453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6817","nonce":1906568453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6815","nonce":1906568453}]},"public_addr":"172.21.15.99:6811/1906568453","cluster_addr":"172.21.15.99:6813/1906568453","heartbeat_back_addr":"172.21.15.99:6817/1906568453","heartbeat_front_addr":"172.21.15.99:6815/1906568453","state":["exists","up"]},{"osd":2,"uuid":"6f71e815-b7bb-46f5-9a1b-1079a065be83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6819","nonce":2385653580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6821","nonce":2385653580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6825","nonce":2385653580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6823","nonce":2385653580}]},"public_addr":"172.21.15.99:6819/2385653580","cluster_addr":"172.21.15.99:6821/2385653580","heartbeat_back_addr":"172.21.15.99:6825/2385653580","heartbeat_front_addr":"172.21.15.99:6823/2385653580","state":["exists","up"]},{"osd":3,"uuid":"caf76464-0af6-40fa-b596-87796509feea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6827","nonce":2645326065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6829","nonce":2645326065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6833","nonce":2645326065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6831","nonce":2645326065}]},"public_addr":"172.21.15.99:6827/2645326065","cluster_addr":"172.21.15.99:6829/2645326065","heartbeat_back_addr":"172.21.15.99:6833/2645326065","heartbeat_front_addr":"172.21.15.99:6831/2645326065","state":["exists","up"]},{"osd":4,"uuid":"7440d499-f65f-4aab-94c1-2a282913ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6801","nonce":3461120502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6803","nonce":3461120502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6807","nonce":3461120502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6805","nonce":3461120502}]},"public_addr":"172.21.15.138:6801/3461120502","cluster_addr":"172.21.15.138:6803/3461120502","heartbeat_back_addr":"172.21.15.138:6807/3461120502","heartbeat_front_addr":"172.21.15.138:6805/3461120502","state":["exists","up"]},{"osd":5,"uuid":"6bf2ce61-d2cf-460a-8b0a-2cb3a0b4842e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6809","nonce":2231958133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6811","nonce":2231958133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6815","nonce":2231958133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6813","nonce":2231958133}]},"public_addr":"172.21.15.138:6809/2231958133","cluster_addr":"172.21.15.138:6811/2231958133","heartbeat_back_addr":"172.21.15.138:6815/2231958133","heartbeat_front_addr":"172.21.15.138:6813/2231958133","state":["exists","up"]},{"osd":6,"uuid":"c9bd96cc-87b6-4d3b-99e3-806ab0f6645e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6817","nonce":2446479280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6819","nonce":2446479280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6823","nonce":2446479280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6821","nonce":2446479280}]},"public_addr":"172.21.15.138:6817/2446479280","cluster_addr":"172.21.15.138:6819/2446479280","heartbeat_back_addr":"172.21.15.138:6823/2446479280","heartbeat_front_addr":"172.21.15.138:6821/2446479280","state":["exists","up"]},{"osd":7,"uuid":"9433197d-4bc1-458f-8abd-7f3bc926475b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6825","nonce":1656205368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6827","nonce":1656205368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6831","nonce":1656205368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6829","nonce":1656205368}]},"public_addr":"172.21.15.138:6825/1656205368","cluster_addr":"172.21.15.138:6827/1656205368","heartbeat_back_addr":"172.21.15.138:6831/1656205368","heartbeat_front_addr":"172.21.15.138:6829/1656205368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:53:59.171256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:26.362470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:52.547796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:20.628328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:44.993539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:12.137359+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:38.951231+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:57:07.011358+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6801/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6800/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1027099157":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6801/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:6800/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/2740163342":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/3517340242":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1183541513":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/957748873":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6800/3240823228":"2024-02-20T21:51:02.178299+0000","172.21.15.99:0/610705141":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6801/3240823228":"2024-02-20T21:51:02.178299+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T21:58:46.912 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-19T21:54:54.711439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.foo.meta', 'create_time': '2024-02-19T21:58:39.068104+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'foo'}}}, {'pool': 3, 'pool_name': 'cephfs.foo.data', 'create_time': '2024-02-19T21:58:39.705512+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'foo'}}}, {'pool': 4, 'pool_name': 'cephfs.bar.meta', 'create_time': '2024-02-19T21:58:44.596747+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'bar'}}}, {'pool': 5, 'pool_name': 'cephfs.bar.data', 'create_time': '2024-02-19T21:58:44.891087+0000', 'flags': 163841, 'flags_names': 'hashpspool,creating,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'bar'}}}] 2024-02-19T21:58:46.913 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-02-19T21:58:47.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:58:45.682525+0000 mgr.smithi099.zfglya (mgr.14180) 266 : cephadm [INF] Saving service mds.bar spec with placement count:2 2024-02-19T21:58:47.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:46.678440+0000 mon.smithi099 (mon.0) 629 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-19T21:58:47.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:46.692371+0000 mon.smithi099 (mon.0) 630 : cluster [DBG] mds.? [v2:172.21.15.99:6834/1068101591,v1:172.21.15.99:6835/1068101591] up:active 2024-02-19T21:58:47.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:46.692425+0000 mon.smithi099 (mon.0) 631 : cluster [DBG] fsmap foo:0 bar:1 {bar:0=foo.smithi099.berqpt=up:active} 2024-02-19T21:58:47.203 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-19T21:58:47.214 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:58:45.682525+0000 mgr.smithi099.zfglya (mgr.14180) 266 : cephadm [INF] Saving service mds.bar spec with placement count:2 2024-02-19T21:58:47.214 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:46.678440+0000 mon.smithi099 (mon.0) 629 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-19T21:58:47.214 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:46.692371+0000 mon.smithi099 (mon.0) 630 : cluster [DBG] mds.? [v2:172.21.15.99:6834/1068101591,v1:172.21.15.99:6835/1068101591] up:active 2024-02-19T21:58:47.214 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:46.692425+0000 mon.smithi099 (mon.0) 631 : cluster [DBG] fsmap foo:0 bar:1 {bar:0=foo.smithi099.berqpt=up:active} 2024-02-19T21:58:47.217 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.foo.meta pg_num 2024-02-19T21:58:47.509 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-19T21:58:47.523 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.foo.data pg_num 2024-02-19T21:58:47.837 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-19T21:58:47.852 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.bar.meta pg_num 2024-02-19T21:58:48.154 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-19T21:58:48.168 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:46.373268+0000 mgr.smithi099.zfglya (mgr.14180) 267 : cluster [DBG] pgmap v239: 129 pgs: 6 creating+peering, 55 unknown, 68 active+clean; 554 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:48.168 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:46.898819+0000 mon.smithi099 (mon.0) 632 : audit [DBG] from='client.? 172.21.15.99:0/3537882341' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:58:48.168 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:47.205107+0000 mon.smithi099 (mon.0) 633 : audit [DBG] from='client.? 172.21.15.99:0/1138043770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-19T21:58:48.168 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:47.510644+0000 mon.smithi099 (mon.0) 634 : audit [DBG] from='client.? 172.21.15.99:0/1751443785' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.foo.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:58:48.168 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:47.546980+0000 mon.smithi099 (mon.0) 635 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:48.168 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:47.548103+0000 mon.smithi099 (mon.0) 636 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:58:48.168 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:47.679699+0000 mon.smithi099 (mon.0) 637 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-19T21:58:48.168 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:47.838774+0000 mon.smithi099 (mon.0) 638 : audit [DBG] from='client.? 172.21.15.99:0/321834022' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.foo.data", "var": "pg_num"}]: dispatch 2024-02-19T21:58:48.169 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.bar.data pg_num 2024-02-19T21:58:48.272 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:46.373268+0000 mgr.smithi099.zfglya (mgr.14180) 267 : cluster [DBG] pgmap v239: 129 pgs: 6 creating+peering, 55 unknown, 68 active+clean; 554 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:58:48.272 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:46.898819+0000 mon.smithi099 (mon.0) 632 : audit [DBG] from='client.? 172.21.15.99:0/3537882341' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:58:48.272 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:47.205107+0000 mon.smithi099 (mon.0) 633 : audit [DBG] from='client.? 172.21.15.99:0/1138043770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-19T21:58:48.272 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:47.510644+0000 mon.smithi099 (mon.0) 634 : audit [DBG] from='client.? 172.21.15.99:0/1751443785' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.foo.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:58:48.272 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:47.546980+0000 mon.smithi099 (mon.0) 635 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:48.272 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:47.548103+0000 mon.smithi099 (mon.0) 636 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:58:48.273 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:47.679699+0000 mon.smithi099 (mon.0) 637 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-19T21:58:48.273 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:47.838774+0000 mon.smithi099 (mon.0) 638 : audit [DBG] from='client.? 172.21.15.99:0/321834022' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.foo.data", "var": "pg_num"}]: dispatch 2024-02-19T21:58:48.475 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-19T21:58:48.489 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T21:58:48.841 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:58:48.841 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T21:58:40.481972+0000","modified":"2024-02-19T21:58:47.903644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24279":{"gid":24279,"name":"foo.smithi138.lynaor","rank":0,"incarnation":6,"state":"up:creating","state_seq":1,"addr":"172.21.15.138:6833/2804829645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2804829645},{"type":"v1","addr":"172.21.15.138:6833","nonce":2804829645}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":4,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T21:58:45.667355+0000","modified":"2024-02-19T21:58:46.684058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24269":{"gid":24269,"name":"foo.smithi099.berqpt","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.99:6835/1068101591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1068101591},{"type":"v1","addr":"172.21.15.99:6835","nonce":1068101591}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","standby_count_wanted":1},"id":2}]} 2024-02-19T21:58:48.843 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 6 2024-02-19T21:58:48.855 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T21:58:49.159 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:58:49.160 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":61,"fsid":"d4704266-cf70-11ee-95bb-87774f69a715","created":"2024-02-19T21:50:39.857499+0000","modified":"2024-02-19T21:58:47.675843+0000","last_up_change":"2024-02-19T21:57:08.941202+0000","last_in_change":"2024-02-19T21:56:50.167513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-19T21:54:54.711439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.foo.meta","create_time":"2024-02-19T21:58:39.068104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"foo"}}},{"pool":3,"pool_name":"cephfs.foo.data","create_time":"2024-02-19T21:58:39.705512+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"foo"}}},{"pool":4,"pool_name":"cephfs.bar.meta","create_time":"2024-02-19T21:58:44.596747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"bar"}}},{"pool":5,"pool_name":"cephfs.bar.data","create_time":"2024-02-19T21:58:44.891087+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"bar"}}}],"osds":[{"osd":0,"uuid":"e53b344b-7e5c-40ce-a9fb-75cabf0a2e38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6803","nonce":3368424446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6805","nonce":3368424446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6809","nonce":3368424446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6807","nonce":3368424446}]},"public_addr":"172.21.15.99:6803/3368424446","cluster_addr":"172.21.15.99:6805/3368424446","heartbeat_back_addr":"172.21.15.99:6809/3368424446","heartbeat_front_addr":"172.21.15.99:6807/3368424446","state":["exists","up"]},{"osd":1,"uuid":"ee0c10da-32d9-4965-b77c-3af025167ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6811","nonce":1906568453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6813","nonce":1906568453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6817","nonce":1906568453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6815","nonce":1906568453}]},"public_addr":"172.21.15.99:6811/1906568453","cluster_addr":"172.21.15.99:6813/1906568453","heartbeat_back_addr":"172.21.15.99:6817/1906568453","heartbeat_front_addr":"172.21.15.99:6815/1906568453","state":["exists","up"]},{"osd":2,"uuid":"6f71e815-b7bb-46f5-9a1b-1079a065be83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6819","nonce":2385653580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6821","nonce":2385653580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6825","nonce":2385653580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6823","nonce":2385653580}]},"public_addr":"172.21.15.99:6819/2385653580","cluster_addr":"172.21.15.99:6821/2385653580","heartbeat_back_addr":"172.21.15.99:6825/2385653580","heartbeat_front_addr":"172.21.15.99:6823/2385653580","state":["exists","up"]},{"osd":3,"uuid":"caf76464-0af6-40fa-b596-87796509feea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6827","nonce":2645326065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6829","nonce":2645326065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6833","nonce":2645326065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6831","nonce":2645326065}]},"public_addr":"172.21.15.99:6827/2645326065","cluster_addr":"172.21.15.99:6829/2645326065","heartbeat_back_addr":"172.21.15.99:6833/2645326065","heartbeat_front_addr":"172.21.15.99:6831/2645326065","state":["exists","up"]},{"osd":4,"uuid":"7440d499-f65f-4aab-94c1-2a282913ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6801","nonce":3461120502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6803","nonce":3461120502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6807","nonce":3461120502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6805","nonce":3461120502}]},"public_addr":"172.21.15.138:6801/3461120502","cluster_addr":"172.21.15.138:6803/3461120502","heartbeat_back_addr":"172.21.15.138:6807/3461120502","heartbeat_front_addr":"172.21.15.138:6805/3461120502","state":["exists","up"]},{"osd":5,"uuid":"6bf2ce61-d2cf-460a-8b0a-2cb3a0b4842e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6809","nonce":2231958133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6811","nonce":2231958133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6815","nonce":2231958133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6813","nonce":2231958133}]},"public_addr":"172.21.15.138:6809/2231958133","cluster_addr":"172.21.15.138:6811/2231958133","heartbeat_back_addr":"172.21.15.138:6815/2231958133","heartbeat_front_addr":"172.21.15.138:6813/2231958133","state":["exists","up"]},{"osd":6,"uuid":"c9bd96cc-87b6-4d3b-99e3-806ab0f6645e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6817","nonce":2446479280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6819","nonce":2446479280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6823","nonce":2446479280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6821","nonce":2446479280}]},"public_addr":"172.21.15.138:6817/2446479280","cluster_addr":"172.21.15.138:6819/2446479280","heartbeat_back_addr":"172.21.15.138:6823/2446479280","heartbeat_front_addr":"172.21.15.138:6821/2446479280","state":["exists","up"]},{"osd":7,"uuid":"9433197d-4bc1-458f-8abd-7f3bc926475b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6825","nonce":1656205368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6827","nonce":1656205368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6831","nonce":1656205368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6829","nonce":1656205368}]},"public_addr":"172.21.15.138:6825/1656205368","cluster_addr":"172.21.15.138:6827/1656205368","heartbeat_back_addr":"172.21.15.138:6831/1656205368","heartbeat_front_addr":"172.21.15.138:6829/1656205368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:53:59.171256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:26.362470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:52.547796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:20.628328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:44.993539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:12.137359+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:38.951231+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:57:07.011358+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6801/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6800/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1027099157":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6801/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:6800/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/2740163342":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/3517340242":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1183541513":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/957748873":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6800/3240823228":"2024-02-20T21:51:02.178299+0000","172.21.15.99:0/610705141":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6801/3240823228":"2024-02-20T21:51:02.178299+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T21:58:49.172 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:47.903577+0000 mon.smithi099 (mon.0) 639 : cluster [DBG] mds.? [v2:172.21.15.138:6832/2804829645,v1:172.21.15.138:6833/2804829645] up:boot 2024-02-19T21:58:49.172 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:47.903618+0000 mon.smithi099 (mon.0) 640 : cluster [INF] daemon mds.foo.smithi138.lynaor assigned to filesystem foo as rank 0 (now has 1 ranks) 2024-02-19T21:58:49.172 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:47.903693+0000 mon.smithi099 (mon.0) 641 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-19T21:58:49.172 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:47.903708+0000 mon.smithi099 (mon.0) 642 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-19T21:58:49.172 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:47.903719+0000 mon.smithi099 (mon.0) 643 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-19T21:58:49.172 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:47.903913+0000 mon.smithi099 (mon.0) 644 : cluster [DBG] fsmap foo:0 bar:1 {bar:0=foo.smithi099.berqpt=up:active} 1 up:standby 2024-02-19T21:58:49.172 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:47.904015+0000 mon.smithi099 (mon.0) 645 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mds metadata", "who": "foo.smithi138.lynaor"}]: dispatch 2024-02-19T21:58:49.173 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:47.906931+0000 mon.smithi099 (mon.0) 646 : cluster [DBG] fsmap foo:1 bar:1 {bar:0=foo.smithi099.berqpt=up:active,foo:0=foo.smithi138.lynaor=up:creating} 2024-02-19T21:58:49.173 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:47.916801+0000 mon.smithi099 (mon.0) 647 : cluster [INF] daemon mds.foo.smithi138.lynaor is now active in filesystem foo as rank 0 2024-02-19T21:58:49.173 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:48.156060+0000 mon.smithi099 (mon.0) 648 : audit [DBG] from='client.? 172.21.15.99:0/1650684232' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.bar.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:58:49.173 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:48.476493+0000 mon.smithi099 (mon.0) 649 : audit [DBG] from='client.? 172.21.15.99:0/2189296623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.bar.data", "var": "pg_num"}]: dispatch 2024-02-19T21:58:49.173 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:48.842610+0000 mon.smithi099 (mon.0) 650 : audit [DBG] from='client.? 172.21.15.99:0/787089897' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T21:58:49.174 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-19T21:54:54.711439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.foo.meta', 'create_time': '2024-02-19T21:58:39.068104+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'foo'}}}, {'pool': 3, 'pool_name': 'cephfs.foo.data', 'create_time': '2024-02-19T21:58:39.705512+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'foo'}}}, {'pool': 4, 'pool_name': 'cephfs.bar.meta', 'create_time': '2024-02-19T21:58:44.596747+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'bar'}}}, {'pool': 5, 'pool_name': 'cephfs.bar.data', 'create_time': '2024-02-19T21:58:44.891087+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'bar'}}}] 2024-02-19T21:58:49.175 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-02-19T21:58:49.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:47.903577+0000 mon.smithi099 (mon.0) 639 : cluster [DBG] mds.? [v2:172.21.15.138:6832/2804829645,v1:172.21.15.138:6833/2804829645] up:boot 2024-02-19T21:58:49.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:47.903618+0000 mon.smithi099 (mon.0) 640 : cluster [INF] daemon mds.foo.smithi138.lynaor assigned to filesystem foo as rank 0 (now has 1 ranks) 2024-02-19T21:58:49.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:47.903693+0000 mon.smithi099 (mon.0) 641 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-19T21:58:49.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:47.903708+0000 mon.smithi099 (mon.0) 642 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-19T21:58:49.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:47.903719+0000 mon.smithi099 (mon.0) 643 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-19T21:58:49.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:47.903913+0000 mon.smithi099 (mon.0) 644 : cluster [DBG] fsmap foo:0 bar:1 {bar:0=foo.smithi099.berqpt=up:active} 1 up:standby 2024-02-19T21:58:49.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:47.904015+0000 mon.smithi099 (mon.0) 645 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mds metadata", "who": "foo.smithi138.lynaor"}]: dispatch 2024-02-19T21:58:49.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:47.906931+0000 mon.smithi099 (mon.0) 646 : cluster [DBG] fsmap foo:1 bar:1 {bar:0=foo.smithi099.berqpt=up:active,foo:0=foo.smithi138.lynaor=up:creating} 2024-02-19T21:58:49.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:47.916801+0000 mon.smithi099 (mon.0) 647 : cluster [INF] daemon mds.foo.smithi138.lynaor is now active in filesystem foo as rank 0 2024-02-19T21:58:49.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:48.156060+0000 mon.smithi099 (mon.0) 648 : audit [DBG] from='client.? 172.21.15.99:0/1650684232' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.bar.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:58:49.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:48.476493+0000 mon.smithi099 (mon.0) 649 : audit [DBG] from='client.? 172.21.15.99:0/2189296623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.bar.data", "var": "pg_num"}]: dispatch 2024-02-19T21:58:49.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:48.842610+0000 mon.smithi099 (mon.0) 650 : audit [DBG] from='client.? 172.21.15.99:0/787089897' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T21:58:49.485 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-19T21:58:49.501 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.foo.meta pg_num 2024-02-19T21:58:49.809 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-19T21:58:49.825 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.foo.data pg_num 2024-02-19T21:58:50.119 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-19T21:58:50.132 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:48.373647+0000 mgr.smithi099.zfglya (mgr.14180) 268 : cluster [DBG] pgmap v242: 129 pgs: 1 creating+activating, 6 creating+peering, 34 unknown, 88 active+clean; 658 B data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.5 KiB/s wr, 3 op/s 2024-02-19T21:58:50.132 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:48.918078+0000 mon.smithi099 (mon.0) 651 : cluster [DBG] mds.? [v2:172.21.15.138:6832/2804829645,v1:172.21.15.138:6833/2804829645] up:active 2024-02-19T21:58:50.132 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:48.918149+0000 mon.smithi099 (mon.0) 652 : cluster [DBG] fsmap foo:1 bar:1 {bar:0=foo.smithi099.berqpt=up:active,foo:0=foo.smithi138.lynaor=up:active} 2024-02-19T21:58:50.132 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:49.159978+0000 mon.smithi099 (mon.0) 653 : audit [DBG] from='client.? 172.21.15.99:0/2718478639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:58:50.132 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:49.486691+0000 mon.smithi099 (mon.0) 654 : audit [DBG] from='client.? 172.21.15.99:0/608551313' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-19T21:58:50.132 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:49.517747+0000 mon.smithi099 (mon.0) 655 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:50.133 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:49.743901+0000 mon.smithi099 (mon.0) 656 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:50.133 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:49.810725+0000 mon.smithi099 (mon.0) 657 : audit [DBG] from='client.? 172.21.15.99:0/2674606721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.foo.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:58:50.134 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.bar.meta pg_num 2024-02-19T21:58:50.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:48.373647+0000 mgr.smithi099.zfglya (mgr.14180) 268 : cluster [DBG] pgmap v242: 129 pgs: 1 creating+activating, 6 creating+peering, 34 unknown, 88 active+clean; 658 B data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.5 KiB/s wr, 3 op/s 2024-02-19T21:58:50.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:48.918078+0000 mon.smithi099 (mon.0) 651 : cluster [DBG] mds.? [v2:172.21.15.138:6832/2804829645,v1:172.21.15.138:6833/2804829645] up:active 2024-02-19T21:58:50.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:48.918149+0000 mon.smithi099 (mon.0) 652 : cluster [DBG] fsmap foo:1 bar:1 {bar:0=foo.smithi099.berqpt=up:active,foo:0=foo.smithi138.lynaor=up:active} 2024-02-19T21:58:50.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:49.159978+0000 mon.smithi099 (mon.0) 653 : audit [DBG] from='client.? 172.21.15.99:0/2718478639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:58:50.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:49.486691+0000 mon.smithi099 (mon.0) 654 : audit [DBG] from='client.? 172.21.15.99:0/608551313' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-19T21:58:50.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:49.517747+0000 mon.smithi099 (mon.0) 655 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:50.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:49.743901+0000 mon.smithi099 (mon.0) 656 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:50.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:49.810725+0000 mon.smithi099 (mon.0) 657 : audit [DBG] from='client.? 172.21.15.99:0/2674606721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.foo.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:58:50.434 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-19T21:58:50.448 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.bar.data pg_num 2024-02-19T21:58:50.749 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-19T21:58:50.763 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T21:58:51.108 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:58:51.108 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T21:58:40.481972+0000","modified":"2024-02-19T21:58:48.905988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24279":{"gid":24279,"name":"foo.smithi138.lynaor","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.138:6833/2804829645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2804829645},{"type":"v1","addr":"172.21.15.138:6833","nonce":2804829645}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":4,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T21:58:45.667355+0000","modified":"2024-02-19T21:58:46.684058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24269":{"gid":24269,"name":"foo.smithi099.berqpt","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.99:6835/1068101591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1068101591},{"type":"v1","addr":"172.21.15.99:6835","nonce":1068101591}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","standby_count_wanted":1},"id":2}]} 2024-02-19T21:58:51.110 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 7 2024-02-19T21:58:51.122 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:50.121011+0000 mon.smithi099 (mon.0) 658 : audit [DBG] from='client.? 172.21.15.99:0/820379388' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.foo.data", "var": "pg_num"}]: dispatch 2024-02-19T21:58:51.123 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:50.435916+0000 mon.smithi099 (mon.0) 659 : audit [DBG] from='client.? 172.21.15.99:0/2486887972' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.bar.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:58:51.123 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:50.750228+0000 mon.smithi099 (mon.0) 660 : audit [DBG] from='client.? 172.21.15.99:0/1231472729' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.bar.data", "var": "pg_num"}]: dispatch 2024-02-19T21:58:51.124 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T21:58:51.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:50.121011+0000 mon.smithi099 (mon.0) 658 : audit [DBG] from='client.? 172.21.15.99:0/820379388' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.foo.data", "var": "pg_num"}]: dispatch 2024-02-19T21:58:51.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:50.435916+0000 mon.smithi099 (mon.0) 659 : audit [DBG] from='client.? 172.21.15.99:0/2486887972' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.bar.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:58:51.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:50.750228+0000 mon.smithi099 (mon.0) 660 : audit [DBG] from='client.? 172.21.15.99:0/1231472729' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.bar.data", "var": "pg_num"}]: dispatch 2024-02-19T21:58:51.420 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:58:51.420 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":61,"fsid":"d4704266-cf70-11ee-95bb-87774f69a715","created":"2024-02-19T21:50:39.857499+0000","modified":"2024-02-19T21:58:47.675843+0000","last_up_change":"2024-02-19T21:57:08.941202+0000","last_in_change":"2024-02-19T21:56:50.167513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-19T21:54:54.711439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.foo.meta","create_time":"2024-02-19T21:58:39.068104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"foo"}}},{"pool":3,"pool_name":"cephfs.foo.data","create_time":"2024-02-19T21:58:39.705512+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"foo"}}},{"pool":4,"pool_name":"cephfs.bar.meta","create_time":"2024-02-19T21:58:44.596747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"bar"}}},{"pool":5,"pool_name":"cephfs.bar.data","create_time":"2024-02-19T21:58:44.891087+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"bar"}}}],"osds":[{"osd":0,"uuid":"e53b344b-7e5c-40ce-a9fb-75cabf0a2e38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6803","nonce":3368424446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6805","nonce":3368424446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6809","nonce":3368424446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6807","nonce":3368424446}]},"public_addr":"172.21.15.99:6803/3368424446","cluster_addr":"172.21.15.99:6805/3368424446","heartbeat_back_addr":"172.21.15.99:6809/3368424446","heartbeat_front_addr":"172.21.15.99:6807/3368424446","state":["exists","up"]},{"osd":1,"uuid":"ee0c10da-32d9-4965-b77c-3af025167ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6811","nonce":1906568453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6813","nonce":1906568453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6817","nonce":1906568453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6815","nonce":1906568453}]},"public_addr":"172.21.15.99:6811/1906568453","cluster_addr":"172.21.15.99:6813/1906568453","heartbeat_back_addr":"172.21.15.99:6817/1906568453","heartbeat_front_addr":"172.21.15.99:6815/1906568453","state":["exists","up"]},{"osd":2,"uuid":"6f71e815-b7bb-46f5-9a1b-1079a065be83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6819","nonce":2385653580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6821","nonce":2385653580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6825","nonce":2385653580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6823","nonce":2385653580}]},"public_addr":"172.21.15.99:6819/2385653580","cluster_addr":"172.21.15.99:6821/2385653580","heartbeat_back_addr":"172.21.15.99:6825/2385653580","heartbeat_front_addr":"172.21.15.99:6823/2385653580","state":["exists","up"]},{"osd":3,"uuid":"caf76464-0af6-40fa-b596-87796509feea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6827","nonce":2645326065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6829","nonce":2645326065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6833","nonce":2645326065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6831","nonce":2645326065}]},"public_addr":"172.21.15.99:6827/2645326065","cluster_addr":"172.21.15.99:6829/2645326065","heartbeat_back_addr":"172.21.15.99:6833/2645326065","heartbeat_front_addr":"172.21.15.99:6831/2645326065","state":["exists","up"]},{"osd":4,"uuid":"7440d499-f65f-4aab-94c1-2a282913ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6801","nonce":3461120502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6803","nonce":3461120502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6807","nonce":3461120502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6805","nonce":3461120502}]},"public_addr":"172.21.15.138:6801/3461120502","cluster_addr":"172.21.15.138:6803/3461120502","heartbeat_back_addr":"172.21.15.138:6807/3461120502","heartbeat_front_addr":"172.21.15.138:6805/3461120502","state":["exists","up"]},{"osd":5,"uuid":"6bf2ce61-d2cf-460a-8b0a-2cb3a0b4842e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6809","nonce":2231958133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6811","nonce":2231958133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6815","nonce":2231958133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6813","nonce":2231958133}]},"public_addr":"172.21.15.138:6809/2231958133","cluster_addr":"172.21.15.138:6811/2231958133","heartbeat_back_addr":"172.21.15.138:6815/2231958133","heartbeat_front_addr":"172.21.15.138:6813/2231958133","state":["exists","up"]},{"osd":6,"uuid":"c9bd96cc-87b6-4d3b-99e3-806ab0f6645e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6817","nonce":2446479280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6819","nonce":2446479280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6823","nonce":2446479280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6821","nonce":2446479280}]},"public_addr":"172.21.15.138:6817/2446479280","cluster_addr":"172.21.15.138:6819/2446479280","heartbeat_back_addr":"172.21.15.138:6823/2446479280","heartbeat_front_addr":"172.21.15.138:6821/2446479280","state":["exists","up"]},{"osd":7,"uuid":"9433197d-4bc1-458f-8abd-7f3bc926475b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6825","nonce":1656205368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6827","nonce":1656205368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6831","nonce":1656205368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6829","nonce":1656205368}]},"public_addr":"172.21.15.138:6825/1656205368","cluster_addr":"172.21.15.138:6827/1656205368","heartbeat_back_addr":"172.21.15.138:6831/1656205368","heartbeat_front_addr":"172.21.15.138:6829/1656205368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:53:59.171256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:26.362470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:52.547796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:20.628328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:44.993539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:12.137359+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:38.951231+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:57:07.011358+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6801/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6800/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1027099157":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6801/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:6800/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/2740163342":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/3517340242":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1183541513":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/957748873":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6800/3240823228":"2024-02-20T21:51:02.178299+0000","172.21.15.99:0/610705141":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6801/3240823228":"2024-02-20T21:51:02.178299+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T21:58:51.436 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-19T21:58:40.481972+0000', 'modified': '2024-02-19T21:58:47.903644+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24279': {'gid': 24279, 'name': 'foo.smithi138.lynaor', 'rank': 0, 'incarnation': 6, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.138:6833/2804829645', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6832', 'nonce': 2804829645}, {'type': 'v1', 'addr': '172.21.15.138:6833', 'nonce': 2804829645}]}, 'join_fscid': 1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'foo', 'balancer': '', 'standby_count_wanted': 0} 2024-02-19T21:58:51.436 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_24279:up:creating 2024-02-19T21:58:52.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:50.374120+0000 mgr.smithi099.zfglya (mgr.14180) 269 : cluster [DBG] pgmap v243: 129 pgs: 1 creating+activating, 4 creating+peering, 5 unknown, 119 active+clean; 2.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.5 KiB/s wr, 12 op/s 2024-02-19T21:58:52.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:51.109022+0000 mon.smithi099 (mon.0) 661 : audit [DBG] from='client.? 172.21.15.99:0/132333198' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T21:58:52.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:51.420307+0000 mon.smithi099 (mon.0) 662 : audit [DBG] from='client.? 172.21.15.99:0/3547615390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:58:52.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:50.374120+0000 mgr.smithi099.zfglya (mgr.14180) 269 : cluster [DBG] pgmap v243: 129 pgs: 1 creating+activating, 4 creating+peering, 5 unknown, 119 active+clean; 2.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.5 KiB/s wr, 12 op/s 2024-02-19T21:58:52.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:51.109022+0000 mon.smithi099 (mon.0) 661 : audit [DBG] from='client.? 172.21.15.99:0/132333198' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T21:58:52.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:51.420307+0000 mon.smithi099 (mon.0) 662 : audit [DBG] from='client.? 172.21.15.99:0/3547615390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:58:52.437 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T21:58:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:58:52.775 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T21:58:40.481972+0000","modified":"2024-02-19T21:58:48.905988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24279":{"gid":24279,"name":"foo.smithi138.lynaor","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.138:6833/2804829645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2804829645},{"type":"v1","addr":"172.21.15.138:6833","nonce":2804829645}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":4,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T21:58:45.667355+0000","modified":"2024-02-19T21:58:46.684058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24269":{"gid":24269,"name":"foo.smithi099.berqpt","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.99:6835/1068101591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1068101591},{"type":"v1","addr":"172.21.15.99:6835","nonce":1068101591}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","standby_count_wanted":1},"id":2}]} 2024-02-19T21:58:52.778 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 7 2024-02-19T21:58:52.790 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-19T21:58:40.481972+0000', 'modified': '2024-02-19T21:58:48.905988+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24279': {'gid': 24279, 'name': 'foo.smithi138.lynaor', 'rank': 0, 'incarnation': 6, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.138:6833/2804829645', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6832', 'nonce': 2804829645}, {'type': 'v1', 'addr': '172.21.15.138:6833', 'nonce': 2804829645}]}, 'join_fscid': 1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'foo', 'balancer': '', 'standby_count_wanted': 0} 2024-02-19T21:58:52.790 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-19T21:58:52.790 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.foo.smithi138.lynaor status 2024-02-19T21:58:52.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-19T21:58:52.919+0000 7f961effd700 0 client.14540 ms_handle_reset on v2:172.21.15.138:6832/2804829645 2024-02-19T21:58:52.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-19T21:58:52.939+0000 7f961effd700 0 client.14544 ms_handle_reset on v2:172.21.15.138:6832/2804829645 2024-02-19T21:58:52.939 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-19T21:58:52.939 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "d4704266-cf70-11ee-95bb-87774f69a715", 2024-02-19T21:58:52.939 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-02-19T21:58:52.939 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 24279, 2024-02-19T21:58:52.939 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-02-19T21:58:52.939 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-02-19T21:58:52.939 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "foo", 2024-02-19T21:58:52.939 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 5.0341589229999997, 2024-02-19T21:58:52.939 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 7, 2024-02-19T21:58:52.939 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 61, 2024-02-19T21:58:52.939 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 61, 2024-02-19T21:58:52.940 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 5.5186740859999999 2024-02-19T21:58:52.940 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-19T21:58:52.951 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T21:58:53.247 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:58:53.247 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":61,"fsid":"d4704266-cf70-11ee-95bb-87774f69a715","created":"2024-02-19T21:50:39.857499+0000","modified":"2024-02-19T21:58:47.675843+0000","last_up_change":"2024-02-19T21:57:08.941202+0000","last_in_change":"2024-02-19T21:56:50.167513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-19T21:54:54.711439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.foo.meta","create_time":"2024-02-19T21:58:39.068104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"foo"}}},{"pool":3,"pool_name":"cephfs.foo.data","create_time":"2024-02-19T21:58:39.705512+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"foo"}}},{"pool":4,"pool_name":"cephfs.bar.meta","create_time":"2024-02-19T21:58:44.596747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"bar"}}},{"pool":5,"pool_name":"cephfs.bar.data","create_time":"2024-02-19T21:58:44.891087+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"bar"}}}],"osds":[{"osd":0,"uuid":"e53b344b-7e5c-40ce-a9fb-75cabf0a2e38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6803","nonce":3368424446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6805","nonce":3368424446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6809","nonce":3368424446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6807","nonce":3368424446}]},"public_addr":"172.21.15.99:6803/3368424446","cluster_addr":"172.21.15.99:6805/3368424446","heartbeat_back_addr":"172.21.15.99:6809/3368424446","heartbeat_front_addr":"172.21.15.99:6807/3368424446","state":["exists","up"]},{"osd":1,"uuid":"ee0c10da-32d9-4965-b77c-3af025167ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6811","nonce":1906568453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6813","nonce":1906568453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6817","nonce":1906568453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6815","nonce":1906568453}]},"public_addr":"172.21.15.99:6811/1906568453","cluster_addr":"172.21.15.99:6813/1906568453","heartbeat_back_addr":"172.21.15.99:6817/1906568453","heartbeat_front_addr":"172.21.15.99:6815/1906568453","state":["exists","up"]},{"osd":2,"uuid":"6f71e815-b7bb-46f5-9a1b-1079a065be83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6819","nonce":2385653580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6821","nonce":2385653580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6825","nonce":2385653580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6823","nonce":2385653580}]},"public_addr":"172.21.15.99:6819/2385653580","cluster_addr":"172.21.15.99:6821/2385653580","heartbeat_back_addr":"172.21.15.99:6825/2385653580","heartbeat_front_addr":"172.21.15.99:6823/2385653580","state":["exists","up"]},{"osd":3,"uuid":"caf76464-0af6-40fa-b596-87796509feea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6827","nonce":2645326065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6829","nonce":2645326065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6833","nonce":2645326065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6831","nonce":2645326065}]},"public_addr":"172.21.15.99:6827/2645326065","cluster_addr":"172.21.15.99:6829/2645326065","heartbeat_back_addr":"172.21.15.99:6833/2645326065","heartbeat_front_addr":"172.21.15.99:6831/2645326065","state":["exists","up"]},{"osd":4,"uuid":"7440d499-f65f-4aab-94c1-2a282913ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6801","nonce":3461120502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6803","nonce":3461120502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6807","nonce":3461120502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6805","nonce":3461120502}]},"public_addr":"172.21.15.138:6801/3461120502","cluster_addr":"172.21.15.138:6803/3461120502","heartbeat_back_addr":"172.21.15.138:6807/3461120502","heartbeat_front_addr":"172.21.15.138:6805/3461120502","state":["exists","up"]},{"osd":5,"uuid":"6bf2ce61-d2cf-460a-8b0a-2cb3a0b4842e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6809","nonce":2231958133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6811","nonce":2231958133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6815","nonce":2231958133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6813","nonce":2231958133}]},"public_addr":"172.21.15.138:6809/2231958133","cluster_addr":"172.21.15.138:6811/2231958133","heartbeat_back_addr":"172.21.15.138:6815/2231958133","heartbeat_front_addr":"172.21.15.138:6813/2231958133","state":["exists","up"]},{"osd":6,"uuid":"c9bd96cc-87b6-4d3b-99e3-806ab0f6645e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6817","nonce":2446479280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6819","nonce":2446479280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6823","nonce":2446479280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6821","nonce":2446479280}]},"public_addr":"172.21.15.138:6817/2446479280","cluster_addr":"172.21.15.138:6819/2446479280","heartbeat_back_addr":"172.21.15.138:6823/2446479280","heartbeat_front_addr":"172.21.15.138:6821/2446479280","state":["exists","up"]},{"osd":7,"uuid":"9433197d-4bc1-458f-8abd-7f3bc926475b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6825","nonce":1656205368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6827","nonce":1656205368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6831","nonce":1656205368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6829","nonce":1656205368}]},"public_addr":"172.21.15.138:6825/1656205368","cluster_addr":"172.21.15.138:6827/1656205368","heartbeat_back_addr":"172.21.15.138:6831/1656205368","heartbeat_front_addr":"172.21.15.138:6829/1656205368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:53:59.171256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:26.362470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:52.547796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:20.628328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:44.993539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:12.137359+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:38.951231+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:57:07.011358+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6801/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6800/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1027099157":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6801/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:6800/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/2740163342":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/3517340242":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1183541513":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/957748873":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6800/3240823228":"2024-02-20T21:51:02.178299+0000","172.21.15.99:0/610705141":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6801/3240823228":"2024-02-20T21:51:02.178299+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T21:58:53.261 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-19T21:54:54.711439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.foo.meta', 'create_time': '2024-02-19T21:58:39.068104+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'foo'}}}, {'pool': 3, 'pool_name': 'cephfs.foo.data', 'create_time': '2024-02-19T21:58:39.705512+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'foo'}}}, {'pool': 4, 'pool_name': 'cephfs.bar.meta', 'create_time': '2024-02-19T21:58:44.596747+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'bar'}}}, {'pool': 5, 'pool_name': 'cephfs.bar.data', 'create_time': '2024-02-19T21:58:44.891087+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'bar'}}}] 2024-02-19T21:58:53.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-02-19T21:58:53.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:52.053087+0000 mon.smithi099 (mon.0) 663 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:53.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:52.060937+0000 mon.smithi099 (mon.0) 664 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:53.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:52.061536+0000 mon.smithi099 (mon.0) 665 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:58:53.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:52.065519+0000 mon.smithi099 (mon.0) 666 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:53.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:52.071965+0000 mon.smithi099 (mon.0) 667 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:53.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:52.072595+0000 mon.smithi099 (mon.0) 668 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "mds.bar.smithi099.pyaktn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T21:58:53.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:52.075346+0000 mon.smithi099 (mon.0) 669 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.smithi099.pyaktn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T21:58:53.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:52.075823+0000 mon.smithi099 (mon.0) 670 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:53.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:58:52.076269+0000 mgr.smithi099.zfglya (mgr.14180) 270 : cephadm [INF] Deploying daemon mds.bar.smithi099.pyaktn on smithi099 2024-02-19T21:58:53.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:52.776720+0000 mon.smithi099 (mon.0) 671 : audit [DBG] from='client.? 172.21.15.99:0/2128965356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T21:58:53.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:52.053087+0000 mon.smithi099 (mon.0) 663 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:53.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:52.060937+0000 mon.smithi099 (mon.0) 664 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:53.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:52.061536+0000 mon.smithi099 (mon.0) 665 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:58:53.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:52.065519+0000 mon.smithi099 (mon.0) 666 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:53.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:52.071965+0000 mon.smithi099 (mon.0) 667 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:53.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:52.072595+0000 mon.smithi099 (mon.0) 668 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "mds.bar.smithi099.pyaktn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T21:58:53.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:52.075346+0000 mon.smithi099 (mon.0) 669 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.smithi099.pyaktn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T21:58:53.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:52.075823+0000 mon.smithi099 (mon.0) 670 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:53.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:58:52.076269+0000 mgr.smithi099.zfglya (mgr.14180) 270 : cephadm [INF] Deploying daemon mds.bar.smithi099.pyaktn on smithi099 2024-02-19T21:58:53.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:52.776720+0000 mon.smithi099 (mon.0) 671 : audit [DBG] from='client.? 172.21.15.99:0/2128965356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T21:58:53.555 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-19T21:58:53.569 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.foo.meta pg_num 2024-02-19T21:58:53.981 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-19T21:58:53.995 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.foo.data pg_num 2024-02-19T21:58:54.081 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:52.374760+0000 mgr.smithi099.zfglya (mgr.14180) 271 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 4.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.2 KiB/s wr, 14 op/s 2024-02-19T21:58:54.081 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:53.247671+0000 mon.smithi099 (mon.0) 672 : audit [DBG] from='client.? 172.21.15.99:0/1491942153' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:58:54.081 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:53.556337+0000 mon.smithi099 (mon.0) 673 : audit [DBG] from='client.? 172.21.15.99:0/3937641586' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-19T21:58:54.081 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:53.982382+0000 mon.smithi099 (mon.0) 674 : audit [DBG] from='client.? 172.21.15.99:0/2123740483' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.foo.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:58:54.303 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-19T21:58:54.319 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.bar.meta pg_num 2024-02-19T21:58:54.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:52.374760+0000 mgr.smithi099.zfglya (mgr.14180) 271 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 4.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.2 KiB/s wr, 14 op/s 2024-02-19T21:58:54.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:53.247671+0000 mon.smithi099 (mon.0) 672 : audit [DBG] from='client.? 172.21.15.99:0/1491942153' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:58:54.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:53.556337+0000 mon.smithi099 (mon.0) 673 : audit [DBG] from='client.? 172.21.15.99:0/3937641586' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-19T21:58:54.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:53.982382+0000 mon.smithi099 (mon.0) 674 : audit [DBG] from='client.? 172.21.15.99:0/2123740483' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.foo.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:58:54.629 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-19T21:58:54.643 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.bar.data pg_num 2024-02-19T21:58:54.943 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-19T21:58:54.957 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T21:58:55.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:54.305179+0000 mon.smithi099 (mon.0) 675 : audit [DBG] from='client.? 172.21.15.99:0/3955889042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.foo.data", "var": "pg_num"}]: dispatch 2024-02-19T21:58:55.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:54.453608+0000 mon.smithi099 (mon.0) 676 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:54.563997+0000 mon.smithi099 (mon.0) 677 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:54.564999+0000 mon.smithi099 (mon.0) 678 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "mds.bar.smithi138.ibobdc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T21:58:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:54.567917+0000 mon.smithi099 (mon.0) 679 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.smithi138.ibobdc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T21:58:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:54.568482+0000 mon.smithi099 (mon.0) 680 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:54.631017+0000 mon.smithi099 (mon.0) 681 : audit [DBG] from='client.? 172.21.15.99:0/2033647079' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.bar.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:58:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:54.897619+0000 mon.smithi099 (mon.0) 682 : cluster [INF] Dropping low affinity active daemon mds.foo.smithi099.berqpt in favor of higher affinity standby. 2024-02-19T21:58:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:54.897650+0000 mon.smithi099 (mon.0) 683 : cluster [WRN] Replacing daemon mds.foo.smithi099.berqpt as rank 0 with standby daemon mds.bar.smithi099.pyaktn 2024-02-19T21:58:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:54.898163+0000 mon.smithi099 (mon.0) 684 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-19T21:58:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:54.902858+0000 mon.smithi099 (mon.0) 685 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-19T21:58:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:54.905530+0000 mon.smithi099 (mon.0) 686 : cluster [DBG] mds.? [v2:172.21.15.99:6836/2774297436,v1:172.21.15.99:6837/2774297436] up:boot 2024-02-19T21:58:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:54.905581+0000 mon.smithi099 (mon.0) 687 : cluster [DBG] fsmap foo:1 bar:1/1 {bar:0=bar.smithi099.pyaktn=up:replay,foo:0=foo.smithi138.lynaor=up:active} 2024-02-19T21:58:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:54.905716+0000 mon.smithi099 (mon.0) 688 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mds metadata", "who": "bar.smithi099.pyaktn"}]: dispatch 2024-02-19T21:58:55.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:54.944265+0000 mon.smithi099 (mon.0) 689 : audit [DBG] from='client.? 172.21.15.99:0/2418010309' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.bar.data", "var": "pg_num"}]: dispatch 2024-02-19T21:58:55.289 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:58:55.289 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T21:58:40.481972+0000","modified":"2024-02-19T21:58:48.905988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24279":{"gid":24279,"name":"foo.smithi138.lynaor","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.138:6833/2804829645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2804829645},{"type":"v1","addr":"172.21.15.138:6833","nonce":2804829645}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","standby_count_wanted":1},"id":1},{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T21:58:45.667355+0000","modified":"2024-02-19T21:58:54.898060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14568":{"gid":14568,"name":"bar.smithi099.pyaktn","rank":0,"incarnation":8,"state":"up:replay","state_seq":1,"addr":"172.21.15.99:6837/2774297436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2774297436},{"type":"v1","addr":"172.21.15.99:6837","nonce":2774297436}]},"join_fscid":2,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","standby_count_wanted":1},"id":2}]} 2024-02-19T21:58:55.291 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-02-19T21:58:55.302 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T21:58:55.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:54.305179+0000 mon.smithi099 (mon.0) 675 : audit [DBG] from='client.? 172.21.15.99:0/3955889042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.foo.data", "var": "pg_num"}]: dispatch 2024-02-19T21:58:55.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:54.453608+0000 mon.smithi099 (mon.0) 676 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:55.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:54.563997+0000 mon.smithi099 (mon.0) 677 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:55.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:54.564999+0000 mon.smithi099 (mon.0) 678 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get-or-create", "entity": "mds.bar.smithi138.ibobdc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T21:58:55.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:54.567917+0000 mon.smithi099 (mon.0) 679 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.smithi138.ibobdc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T21:58:55.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:54.568482+0000 mon.smithi099 (mon.0) 680 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:58:55.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:54.631017+0000 mon.smithi099 (mon.0) 681 : audit [DBG] from='client.? 172.21.15.99:0/2033647079' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.bar.meta", "var": "pg_num"}]: dispatch 2024-02-19T21:58:55.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:54.897619+0000 mon.smithi099 (mon.0) 682 : cluster [INF] Dropping low affinity active daemon mds.foo.smithi099.berqpt in favor of higher affinity standby. 2024-02-19T21:58:55.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:54.897650+0000 mon.smithi099 (mon.0) 683 : cluster [WRN] Replacing daemon mds.foo.smithi099.berqpt as rank 0 with standby daemon mds.bar.smithi099.pyaktn 2024-02-19T21:58:55.501 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:54.898163+0000 mon.smithi099 (mon.0) 684 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-19T21:58:55.502 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:54.902858+0000 mon.smithi099 (mon.0) 685 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-19T21:58:55.502 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:54.905530+0000 mon.smithi099 (mon.0) 686 : cluster [DBG] mds.? [v2:172.21.15.99:6836/2774297436,v1:172.21.15.99:6837/2774297436] up:boot 2024-02-19T21:58:55.502 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:54.905581+0000 mon.smithi099 (mon.0) 687 : cluster [DBG] fsmap foo:1 bar:1/1 {bar:0=bar.smithi099.pyaktn=up:replay,foo:0=foo.smithi138.lynaor=up:active} 2024-02-19T21:58:55.502 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:54.905716+0000 mon.smithi099 (mon.0) 688 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mds metadata", "who": "bar.smithi099.pyaktn"}]: dispatch 2024-02-19T21:58:55.502 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:54.944265+0000 mon.smithi099 (mon.0) 689 : audit [DBG] from='client.? 172.21.15.99:0/2418010309' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.bar.data", "var": "pg_num"}]: dispatch 2024-02-19T21:58:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:58:55.592 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":62,"fsid":"d4704266-cf70-11ee-95bb-87774f69a715","created":"2024-02-19T21:50:39.857499+0000","modified":"2024-02-19T21:58:54.897689+0000","last_up_change":"2024-02-19T21:57:08.941202+0000","last_in_change":"2024-02-19T21:56:50.167513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-19T21:54:54.711439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.foo.meta","create_time":"2024-02-19T21:58:39.068104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"foo"}}},{"pool":3,"pool_name":"cephfs.foo.data","create_time":"2024-02-19T21:58:39.705512+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"foo"}}},{"pool":4,"pool_name":"cephfs.bar.meta","create_time":"2024-02-19T21:58:44.596747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"bar"}}},{"pool":5,"pool_name":"cephfs.bar.data","create_time":"2024-02-19T21:58:44.891087+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"bar"}}}],"osds":[{"osd":0,"uuid":"e53b344b-7e5c-40ce-a9fb-75cabf0a2e38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6803","nonce":3368424446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6805","nonce":3368424446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6809","nonce":3368424446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3368424446},{"type":"v1","addr":"172.21.15.99:6807","nonce":3368424446}]},"public_addr":"172.21.15.99:6803/3368424446","cluster_addr":"172.21.15.99:6805/3368424446","heartbeat_back_addr":"172.21.15.99:6809/3368424446","heartbeat_front_addr":"172.21.15.99:6807/3368424446","state":["exists","up"]},{"osd":1,"uuid":"ee0c10da-32d9-4965-b77c-3af025167ce4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6811","nonce":1906568453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6813","nonce":1906568453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6817","nonce":1906568453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1906568453},{"type":"v1","addr":"172.21.15.99:6815","nonce":1906568453}]},"public_addr":"172.21.15.99:6811/1906568453","cluster_addr":"172.21.15.99:6813/1906568453","heartbeat_back_addr":"172.21.15.99:6817/1906568453","heartbeat_front_addr":"172.21.15.99:6815/1906568453","state":["exists","up"]},{"osd":2,"uuid":"6f71e815-b7bb-46f5-9a1b-1079a065be83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6819","nonce":2385653580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6821","nonce":2385653580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6825","nonce":2385653580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2385653580},{"type":"v1","addr":"172.21.15.99:6823","nonce":2385653580}]},"public_addr":"172.21.15.99:6819/2385653580","cluster_addr":"172.21.15.99:6821/2385653580","heartbeat_back_addr":"172.21.15.99:6825/2385653580","heartbeat_front_addr":"172.21.15.99:6823/2385653580","state":["exists","up"]},{"osd":3,"uuid":"caf76464-0af6-40fa-b596-87796509feea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6827","nonce":2645326065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6829","nonce":2645326065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6833","nonce":2645326065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2645326065},{"type":"v1","addr":"172.21.15.99:6831","nonce":2645326065}]},"public_addr":"172.21.15.99:6827/2645326065","cluster_addr":"172.21.15.99:6829/2645326065","heartbeat_back_addr":"172.21.15.99:6833/2645326065","heartbeat_front_addr":"172.21.15.99:6831/2645326065","state":["exists","up"]},{"osd":4,"uuid":"7440d499-f65f-4aab-94c1-2a282913ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6801","nonce":3461120502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6803","nonce":3461120502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6807","nonce":3461120502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3461120502},{"type":"v1","addr":"172.21.15.138:6805","nonce":3461120502}]},"public_addr":"172.21.15.138:6801/3461120502","cluster_addr":"172.21.15.138:6803/3461120502","heartbeat_back_addr":"172.21.15.138:6807/3461120502","heartbeat_front_addr":"172.21.15.138:6805/3461120502","state":["exists","up"]},{"osd":5,"uuid":"6bf2ce61-d2cf-460a-8b0a-2cb3a0b4842e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6809","nonce":2231958133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6811","nonce":2231958133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6815","nonce":2231958133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2231958133},{"type":"v1","addr":"172.21.15.138:6813","nonce":2231958133}]},"public_addr":"172.21.15.138:6809/2231958133","cluster_addr":"172.21.15.138:6811/2231958133","heartbeat_back_addr":"172.21.15.138:6815/2231958133","heartbeat_front_addr":"172.21.15.138:6813/2231958133","state":["exists","up"]},{"osd":6,"uuid":"c9bd96cc-87b6-4d3b-99e3-806ab0f6645e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6817","nonce":2446479280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6819","nonce":2446479280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6823","nonce":2446479280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2446479280},{"type":"v1","addr":"172.21.15.138:6821","nonce":2446479280}]},"public_addr":"172.21.15.138:6817/2446479280","cluster_addr":"172.21.15.138:6819/2446479280","heartbeat_back_addr":"172.21.15.138:6823/2446479280","heartbeat_front_addr":"172.21.15.138:6821/2446479280","state":["exists","up"]},{"osd":7,"uuid":"9433197d-4bc1-458f-8abd-7f3bc926475b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6825","nonce":1656205368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6827","nonce":1656205368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6831","nonce":1656205368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1656205368},{"type":"v1","addr":"172.21.15.138:6829","nonce":1656205368}]},"public_addr":"172.21.15.138:6825/1656205368","cluster_addr":"172.21.15.138:6827/1656205368","heartbeat_back_addr":"172.21.15.138:6831/1656205368","heartbeat_front_addr":"172.21.15.138:6829/1656205368","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:53:59.171256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:26.362470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:54:52.547796+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:20.628328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:55:44.993539+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:12.137359+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:56:38.951231+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T21:57:07.011358+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6835/1068101591":"2024-02-20T21:58:54.897658+0000","172.21.15.99:6834/1068101591":"2024-02-20T21:58:54.897658+0000","172.21.15.99:6801/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6800/3584389432":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1027099157":"2024-02-20T21:52:24.301071+0000","172.21.15.99:6801/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:6800/325696313":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/2740163342":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/3517340242":"2024-02-20T21:52:24.301071+0000","172.21.15.99:0/1183541513":"2024-02-20T21:51:35.434235+0000","172.21.15.99:0/957748873":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6800/3240823228":"2024-02-20T21:51:02.178299+0000","172.21.15.99:0/610705141":"2024-02-20T21:51:02.178299+0000","172.21.15.99:6801/3240823228":"2024-02-20T21:51:02.178299+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T21:58:55.607 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 4, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-19T21:58:45.667355+0000', 'modified': '2024-02-19T21:58:46.684058+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24269': {'gid': 24269, 'name': 'foo.smithi099.berqpt', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.99:6835/1068101591', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6834', 'nonce': 1068101591}, {'type': 'v1', 'addr': '172.21.15.99:6835', 'nonce': 1068101591}]}, 'join_fscid': 1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'bar', 'balancer': '', 'standby_count_wanted': 1} 2024-02-19T21:58:55.608 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-19T21:58:55.608 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.foo.smithi099.berqpt status 2024-02-19T21:58:55.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-19T21:58:55.732+0000 7f5fb28f6b80 -1 client.14592 resolve_mds: no MDS daemons found by name `foo.smithi099.berqpt' 2024-02-19T21:58:55.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-19T21:58:55.732+0000 7f5fb28f6b80 -1 client.14592 FSMap: foo:1 bar:1/1 {bar:0=bar.smithi099.pyaktn=up:replay,foo:0=foo.smithi138.lynaor=up:active} 2024-02-19T21:58:55.732 INFO:teuthology.orchestra.run.smithi099.stderr:Error ENOENT: problem getting command descriptions from mds.foo.smithi099.berqpt 2024-02-19T21:58:55.735 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-19T21:58:56.385 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:54.375192+0000 mgr.smithi099.zfglya (mgr.14180) 272 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 4.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.1 KiB/s wr, 10 op/s 2024-02-19T21:58:56.385 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T21:58:54.568971+0000 mgr.smithi099.zfglya (mgr.14180) 273 : cephadm [INF] Deploying daemon mds.bar.smithi138.ibobdc on smithi138 2024-02-19T21:58:56.385 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:55.290156+0000 mon.smithi099 (mon.0) 690 : audit [DBG] from='client.? 172.21.15.99:0/348226023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T21:58:56.385 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:55.592510+0000 mon.smithi099 (mon.0) 691 : audit [DBG] from='client.? 172.21.15.99:0/858703872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:58:56.385 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:55.903771+0000 mon.smithi099 (mon.0) 692 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-19T21:58:56.385 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:55.907039+0000 mon.smithi099 (mon.0) 693 : cluster [DBG] mds.? [v2:172.21.15.99:6836/2774297436,v1:172.21.15.99:6837/2774297436] up:reconnect 2024-02-19T21:58:56.386 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:55.907074+0000 mon.smithi099 (mon.0) 694 : cluster [DBG] mds.? [v2:172.21.15.99:6834/853941406,v1:172.21.15.99:6835/853941406] up:boot 2024-02-19T21:58:56.386 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:55.907126+0000 mon.smithi099 (mon.0) 695 : cluster [DBG] fsmap foo:1 bar:1/1 {bar:0=bar.smithi099.pyaktn=up:reconnect,foo:0=foo.smithi138.lynaor=up:active} 1 up:standby 2024-02-19T21:58:56.386 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:55.907214+0000 mon.smithi099 (mon.0) 696 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mds metadata", "who": "foo.smithi099.berqpt"}]: dispatch 2024-02-19T21:58:56.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:54.375192+0000 mgr.smithi099.zfglya (mgr.14180) 272 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 4.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.1 KiB/s wr, 10 op/s 2024-02-19T21:58:56.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T21:58:54.568971+0000 mgr.smithi099.zfglya (mgr.14180) 273 : cephadm [INF] Deploying daemon mds.bar.smithi138.ibobdc on smithi138 2024-02-19T21:58:56.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:55.290156+0000 mon.smithi099 (mon.0) 690 : audit [DBG] from='client.? 172.21.15.99:0/348226023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T21:58:56.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:55.592510+0000 mon.smithi099 (mon.0) 691 : audit [DBG] from='client.? 172.21.15.99:0/858703872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T21:58:56.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:55.903771+0000 mon.smithi099 (mon.0) 692 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-19T21:58:56.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:55.907039+0000 mon.smithi099 (mon.0) 693 : cluster [DBG] mds.? [v2:172.21.15.99:6836/2774297436,v1:172.21.15.99:6837/2774297436] up:reconnect 2024-02-19T21:58:56.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:55.907074+0000 mon.smithi099 (mon.0) 694 : cluster [DBG] mds.? [v2:172.21.15.99:6834/853941406,v1:172.21.15.99:6835/853941406] up:boot 2024-02-19T21:58:56.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:55.907126+0000 mon.smithi099 (mon.0) 695 : cluster [DBG] fsmap foo:1 bar:1/1 {bar:0=bar.smithi099.pyaktn=up:reconnect,foo:0=foo.smithi138.lynaor=up:active} 1 up:standby 2024-02-19T21:58:56.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:55.907214+0000 mon.smithi099 (mon.0) 696 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mds metadata", "who": "foo.smithi099.berqpt"}]: dispatch 2024-02-19T21:58:56.736 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T21:58:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:58:57.078 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14576,"name":"foo.smithi099.berqpt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/853941406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":853941406},{"type":"v1","addr":"172.21.15.99:6835","nonce":853941406}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T21:58:40.481972+0000","modified":"2024-02-19T21:58:48.905988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24279":{"gid":24279,"name":"foo.smithi138.lynaor","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.138:6833/2804829645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2804829645},{"type":"v1","addr":"172.21.15.138:6833","nonce":2804829645}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","standby_count_wanted":1},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T21:58:45.667355+0000","modified":"2024-02-19T21:58:56.904954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14568":{"gid":14568,"name":"bar.smithi099.pyaktn","rank":0,"incarnation":8,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.99:6837/2774297436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2774297436},{"type":"v1","addr":"172.21.15.99:6837","nonce":2774297436}]},"join_fscid":2,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","standby_count_wanted":1},"id":2}]} 2024-02-19T21:58:57.080 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 10 2024-02-19T21:58:57.092 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-19T21:58:45.667355+0000', 'modified': '2024-02-19T21:58:56.904954+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 62, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14568}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14568': {'gid': 14568, 'name': 'bar.smithi099.pyaktn', 'rank': 0, 'incarnation': 8, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.99:6837/2774297436', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 2774297436}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 2774297436}]}, 'join_fscid': 2, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'bar', 'balancer': '', 'standby_count_wanted': 1} 2024-02-19T21:58:57.092 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14568:up:rejoin 2024-02-19T21:58:58.093 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T21:58:58.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:56.375763+0000 mgr.smithi099.zfglya (mgr.14180) 274 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 4.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 235 B/s rd, 2.1 KiB/s wr, 9 op/s 2024-02-19T21:58:58.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:56.908266+0000 mon.smithi099 (mon.0) 697 : cluster [DBG] mds.? [v2:172.21.15.99:6836/2774297436,v1:172.21.15.99:6837/2774297436] up:rejoin 2024-02-19T21:58:58.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:56.908311+0000 mon.smithi099 (mon.0) 698 : cluster [DBG] fsmap foo:1 bar:1/1 {bar:0=bar.smithi099.pyaktn=up:rejoin,foo:0=foo.smithi138.lynaor=up:active} 1 up:standby 2024-02-19T21:58:58.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:56.908426+0000 mon.smithi099 (mon.0) 699 : cluster [INF] daemon mds.bar.smithi099.pyaktn is now active in filesystem bar as rank 0 2024-02-19T21:58:58.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:57.079573+0000 mon.smithi099 (mon.0) 700 : audit [DBG] from='client.? 172.21.15.99:0/2880192074' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T21:58:58.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:57.222848+0000 mon.smithi099 (mon.0) 701 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:58.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:57.223899+0000 mon.smithi099 (mon.0) 702 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:58:58.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:56.375763+0000 mgr.smithi099.zfglya (mgr.14180) 274 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 4.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 235 B/s rd, 2.1 KiB/s wr, 9 op/s 2024-02-19T21:58:58.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:56.908266+0000 mon.smithi099 (mon.0) 697 : cluster [DBG] mds.? [v2:172.21.15.99:6836/2774297436,v1:172.21.15.99:6837/2774297436] up:rejoin 2024-02-19T21:58:58.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:56.908311+0000 mon.smithi099 (mon.0) 698 : cluster [DBG] fsmap foo:1 bar:1/1 {bar:0=bar.smithi099.pyaktn=up:rejoin,foo:0=foo.smithi138.lynaor=up:active} 1 up:standby 2024-02-19T21:58:58.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:56.908426+0000 mon.smithi099 (mon.0) 699 : cluster [INF] daemon mds.bar.smithi099.pyaktn is now active in filesystem bar as rank 0 2024-02-19T21:58:58.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:57.079573+0000 mon.smithi099 (mon.0) 700 : audit [DBG] from='client.? 172.21.15.99:0/2880192074' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T21:58:58.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:57.222848+0000 mon.smithi099 (mon.0) 701 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:58:58.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:57.223899+0000 mon.smithi099 (mon.0) 702 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:58:58.445 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-19T21:58:58.446 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14576,"name":"foo.smithi099.berqpt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/853941406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":853941406},{"type":"v1","addr":"172.21.15.99:6835","nonce":853941406}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24363,"name":"bar.smithi138.ibobdc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3619176264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":3619176264},{"type":"v1","addr":"172.21.15.138:6835","nonce":3619176264}]},"join_fscid":2,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T21:58:40.481972+0000","modified":"2024-02-19T21:58:48.905988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24279":{"gid":24279,"name":"foo.smithi138.lynaor","rank":0,"incarnation":6,"state":"up:active","state_seq":2,"addr":"172.21.15.138:6833/2804829645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2804829645},{"type":"v1","addr":"172.21.15.138:6833","nonce":2804829645}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","standby_count_wanted":1},"id":1},{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T21:58:45.667355+0000","modified":"2024-02-19T21:58:57.906602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14568":{"gid":14568,"name":"bar.smithi099.pyaktn","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6837/2774297436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":2774297436},{"type":"v1","addr":"172.21.15.99:6837","nonce":2774297436}]},"join_fscid":2,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","standby_count_wanted":1},"id":2}]} 2024-02-19T21:58:58.448 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 11 2024-02-19T21:58:58.459 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-19T21:58:45.667355+0000', 'modified': '2024-02-19T21:58:57.906602+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 62, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14568}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14568': {'gid': 14568, 'name': 'bar.smithi099.pyaktn', 'rank': 0, 'incarnation': 8, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.99:6837/2774297436', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 2774297436}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 2774297436}]}, 'join_fscid': 2, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'bar', 'balancer': '', 'standby_count_wanted': 1} 2024-02-19T21:58:58.459 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-19T21:58:58.459 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.bar.smithi099.pyaktn status 2024-02-19T21:58:58.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-19T21:58:58.589+0000 7fb1897fa700 0 client.14612 ms_handle_reset on v2:172.21.15.99:6836/2774297436 2024-02-19T21:58:58.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-19T21:58:58.610+0000 7fb1897fa700 0 client.14616 ms_handle_reset on v2:172.21.15.99:6836/2774297436 2024-02-19T21:58:58.610 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-19T21:58:58.610 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "d4704266-cf70-11ee-95bb-87774f69a715", 2024-02-19T21:58:58.610 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-02-19T21:58:58.610 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 14568, 2024-02-19T21:58:58.611 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-02-19T21:58:58.611 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-02-19T21:58:58.611 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "bar", 2024-02-19T21:58:58.611 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 3.7073127829999999, 2024-02-19T21:58:58.611 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 11, 2024-02-19T21:58:58.611 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 62, 2024-02-19T21:58:58.611 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 62, 2024-02-19T21:58:58.611 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 4.1584654560000001 2024-02-19T21:58:58.611 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-19T21:58:58.622 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-02-19T21:58:58.646 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-02-19T21:58:58.646 INFO:tasks.ceph_fuse:config is {'client.0': {'cephfs_name': 'foo'}} 2024-02-19T21:58:58.646 INFO:tasks.ceph_fuse:client.0 config is {'cephfs_name': 'foo'} 2024-02-19T21:58:58.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:58:58.647 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-02-19T21:58:58.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:58:58.666 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-02-19T21:58:58.737 INFO:teuthology.orchestra.run.smithi099.stderr:Cannot find device "ceph-brx" 2024-02-19T21:58:58.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T21:58:58.738 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-02-19T21:58:58.738 DEBUG:teuthology.orchestra.run.smithi099:> ceph fs ls 2024-02-19T21:58:59.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:57.906648+0000 mon.smithi099 (mon.0) 703 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-19T21:58:59.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:57.906672+0000 mon.smithi099 (mon.0) 704 : cluster [INF] Cluster is now healthy 2024-02-19T21:58:59.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:57.912747+0000 mon.smithi099 (mon.0) 705 : cluster [DBG] mds.? [v2:172.21.15.99:6836/2774297436,v1:172.21.15.99:6837/2774297436] up:active 2024-02-19T21:58:59.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:57.912791+0000 mon.smithi099 (mon.0) 706 : cluster [DBG] mds.? [v2:172.21.15.138:6834/3619176264,v1:172.21.15.138:6835/3619176264] up:boot 2024-02-19T21:58:59.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:57.912846+0000 mon.smithi099 (mon.0) 707 : cluster [DBG] fsmap foo:1 bar:1 {bar:0=bar.smithi099.pyaktn=up:active,foo:0=foo.smithi138.lynaor=up:active} 2 up:standby 2024-02-19T21:58:59.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:57.912949+0000 mon.smithi099 (mon.0) 708 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mds metadata", "who": "bar.smithi138.ibobdc"}]: dispatch 2024-02-19T21:58:59.041 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:58.446684+0000 mon.smithi099 (mon.0) 709 : audit [DBG] from='client.? 172.21.15.99:0/4219788119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T21:58:59.116 INFO:teuthology.orchestra.run.smithi099.stdout:name: foo, metadata pool: cephfs.foo.meta, data pools: [cephfs.foo.data ] 2024-02-19T21:58:59.116 INFO:teuthology.orchestra.run.smithi099.stdout:name: bar, metadata pool: cephfs.bar.meta, data pools: [cephfs.bar.data ] 2024-02-19T21:58:59.130 INFO:tasks.cephfs.mount:Mounting Ceph FS foo; just confirmed its presence on cluster 2024-02-19T21:58:59.130 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-19T21:58:59.130 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-02-19T21:58:59.130 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-19T21:58:59.131 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-19T21:58:59.131 INFO:tasks.cephfs.mount:self.cephfs_name = foo 2024-02-19T21:58:59.131 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-19T21:58:59.131 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-19T21:58:59.131 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-19T21:58:59.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:58:59.131 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-02-19T21:58:59.149 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T21:58:59.149 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T21:58:59.150 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T21:58:59.150 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-02-19T21:58:59.150 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-02-19T21:58:59.150 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-02-19T21:58:59.150 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T21:58:59.150 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-02-19T21:58:59.150 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-02-19T21:58:59.150 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T21:58:59.150 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-02-19T21:58:59.150 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-02-19T21:58:59.150 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T21:58:59.150 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-02-19T21:58:59.150 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-19T21:58:59.150 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-02-19T21:58:59.151 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-19T21:58:59.151 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 41974sec preferred_lft 41974sec 2024-02-19T21:58:59.151 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2024-02-19T21:58:59.151 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-02-19T21:58:59.151 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-19T21:58:59.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:58:59.151 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-19T21:58:59.151 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-19T21:58:59.151 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add name ceph-brx type bridge 2024-02-19T21:58:59.152 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr flush dev ceph-brx 2024-02-19T21:58:59.152 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set ceph-brx up 2024-02-19T21:58:59.152 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-19T21:58:59.152 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-19T21:58:59.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:57.906648+0000 mon.smithi099 (mon.0) 703 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-19T21:58:59.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:57.906672+0000 mon.smithi099 (mon.0) 704 : cluster [INF] Cluster is now healthy 2024-02-19T21:58:59.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:57.912747+0000 mon.smithi099 (mon.0) 705 : cluster [DBG] mds.? [v2:172.21.15.99:6836/2774297436,v1:172.21.15.99:6837/2774297436] up:active 2024-02-19T21:58:59.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:57.912791+0000 mon.smithi099 (mon.0) 706 : cluster [DBG] mds.? [v2:172.21.15.138:6834/3619176264,v1:172.21.15.138:6835/3619176264] up:boot 2024-02-19T21:58:59.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:57.912846+0000 mon.smithi099 (mon.0) 707 : cluster [DBG] fsmap foo:1 bar:1 {bar:0=bar.smithi099.pyaktn=up:active,foo:0=foo.smithi138.lynaor=up:active} 2 up:standby 2024-02-19T21:58:59.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:57.912949+0000 mon.smithi099 (mon.0) 708 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "mds metadata", "who": "bar.smithi138.ibobdc"}]: dispatch 2024-02-19T21:58:59.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:58.446684+0000 mon.smithi099 (mon.0) 709 : audit [DBG] from='client.? 172.21.15.99:0/4219788119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T21:58:59.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:58:59.335 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-19T21:58:59.403 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-02-19T21:58:59.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:58:59.405 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-02-19T21:58:59.496 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-02-19T21:58:59.496 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-19T21:58:59.496 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-19T21:58:59.496 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-19T21:58:59.496 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-19T21:58:59.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:58:59.497 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-19T21:58:59.497 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-19T21:58:59.497 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-19T21:58:59.497 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-19T21:58:59.497 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-19T21:58:59.497 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-19T21:58:59.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:58:59.943 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-02-19T21:58:59.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:58:59.962 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2024-02-19T21:59:00.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:00.021 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-19T21:59:00.021 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-19T21:59:00.022 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T21:59:00.022 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-19T21:59:00.022 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-19T21:59:00.116 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-19T21:59:00.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:00.116 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-19T21:59:00.116 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-19T21:59:00.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-19T21:59:00.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-19T21:59:00.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-19T21:59:00.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-19T21:59:00.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-19T21:59:00.117 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-19T21:59:00.187 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:58:58.376209+0000 mgr.smithi099.zfglya (mgr.14180) 275 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 4.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 818 B/s rd, 1.8 KiB/s wr, 8 op/s 2024-02-19T21:59:00.187 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:59.117597+0000 mon.smithi099 (mon.0) 710 : audit [DBG] from='client.? 172.21.15.99:0/1131056619' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-19T21:59:00.187 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:59.518158+0000 mon.smithi099 (mon.0) 711 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:59:00.187 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:58:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:58:59.527529+0000 mon.smithi099 (mon.0) 712 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:59:00.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:58:58.376209+0000 mgr.smithi099.zfglya (mgr.14180) 275 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 4.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 818 B/s rd, 1.8 KiB/s wr, 8 op/s 2024-02-19T21:59:00.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:59.117597+0000 mon.smithi099 (mon.0) 710 : audit [DBG] from='client.? 172.21.15.99:0/1131056619' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-19T21:59:00.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:59.518158+0000 mon.smithi099 (mon.0) 711 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:59:00.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:58:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:58:59.527529+0000 mon.smithi099 (mon.0) 712 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:59:00.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:00.322 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-19T21:59:00.322 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-19T21:59:00.322 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-02-19T21:59:00.322 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.0 master ceph-brx 2024-02-19T21:59:00.322 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-19T21:59:00.420 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'cephfs_name': 'foo'} 2024-02-19T21:59:00.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-19T21:59:00.421 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2024-02-19T21:59:00.439 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-19T21:59:00.439 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-02-19T21:59:00.506 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-02-19T21:59:00.506 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-02-19T21:59:00.573 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-02-19T21:59:00.574 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-02-19T21:59:00.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-19T21:59:00.575 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-02-19T21:59:00.632 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-19T21:59:00.632 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 --client_fs=foo /home/ubuntu/cephtest/mnt.0 2024-02-19T21:59:00.677 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-02-19T21:59:00.703 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-02-19T21:59:00.703 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-02-19T21:59:00.770 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-02-19T21:59:00.771 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-02-19T21:59:00.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-19T21:59:00.771 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-02-19T21:59:00.829 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:2024-02-19T21:59:00.828+0000 7f209b3083c0 -1 init, newargv = 0x5634e6601a00 newargc=15 2024-02-19T21:59:00.829 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:ceph-fuse[81385]: starting ceph client 2024-02-19T21:59:00.833 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:ceph-fuse[81385]: starting fuse 2024-02-19T21:59:01.931 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-02-19T21:59:01.960 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-02-19T21:59:01.961 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-02-19T21:59:02.027 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-02-19T21:59:02.028 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-02-19T21:59:02.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-19T21:59:02.029 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-02-19T21:59:02.087 INFO:teuthology.orchestra.run.smithi099.stdout:165 2024-02-19T21:59:02.087 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [165] 2024-02-19T21:59:02.087 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-02-19T21:59:02.087 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2024-02-19T21:59:02.087 DEBUG:teuthology.orchestra.run.smithi099:> import re 2024-02-19T21:59:02.087 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-02-19T21:59:02.087 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> def _find_admin_socket(client_name): 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-19T21:59:02.088 DEBUG:teuthology.orchestra.run.smithi099:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-19T21:59:02.089 DEBUG:teuthology.orchestra.run.smithi099:> contents = proc_f.read() 2024-02-19T21:59:02.089 DEBUG:teuthology.orchestra.run.smithi099:> if mountpoint in contents: 2024-02-19T21:59:02.089 DEBUG:teuthology.orchestra.run.smithi099:> return f 2024-02-19T21:59:02.089 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-19T21:59:02.089 DEBUG:teuthology.orchestra.run.smithi099:> 2024-02-19T21:59:02.089 DEBUG:teuthology.orchestra.run.smithi099:> print(_find_admin_socket("client.0")) 2024-02-19T21:59:02.089 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-02-19T21:59:02.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:00.376690+0000 mgr.smithi099.zfglya (mgr.14180) 276 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 4.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-02-19T21:59:02.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:01.910236+0000 mon.smithi099 (mon.0) 713 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:59:02.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:01.911020+0000 mon.smithi099 (mon.0) 714 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:59:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:01.911672+0000 mon.smithi099 (mon.0) 715 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:59:02.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:01.915071+0000 mon.smithi099 (mon.0) 716 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:59:02.210 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.0.81385.asok 2024-02-19T21:59:02.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:00.376690+0000 mgr.smithi099.zfglya (mgr.14180) 276 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 4.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-02-19T21:59:02.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:01.910236+0000 mon.smithi099 (mon.0) 713 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:59:02.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:01.911020+0000 mon.smithi099 (mon.0) 714 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:59:02.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:01.911672+0000 mon.smithi099 (mon.0) 715 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:59:02.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:01.915071+0000 mon.smithi099 (mon.0) 716 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:59:02.392 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.81385.asok 2024-02-19T21:59:02.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-19T21:59:02.392 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.81385.asok status 2024-02-19T21:59:02.544 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-19T21:59:02.544 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2024-02-19T21:59:02.544 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "81bd20d634209c7cb82c18be12b4b5a05643ebf1", 2024-02-19T21:59:02.544 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)", 2024-02-19T21:59:02.544 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "0", 2024-02-19T21:59:02.544 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2024-02-19T21:59:02.545 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-02-19T21:59:02.545 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "81385", 2024-02-19T21:59:02.545 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2024-02-19T21:59:02.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-19T21:59:02.545 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2024-02-19T21:59:02.545 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2024-02-19T21:59:02.545 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 14624, 2024-02-19T21:59:02.545 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2024-02-19T21:59:02.545 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2024-02-19T21:59:02.545 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2024-02-19T21:59:02.545 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 14624 2024-02-19T21:59:02.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-19T21:59:02.545 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2024-02-19T21:59:02.546 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-02-19T21:59:02.546 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.1:0", 2024-02-19T21:59:02.546 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 530794005 2024-02-19T21:59:02.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-19T21:59:02.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-19T21:59:02.546 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2024-02-19T21:59:02.546 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-02-19T21:59:02.546 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.1:0", 2024-02-19T21:59:02.546 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 530794005 2024-02-19T21:59:02.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-19T21:59:02.546 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.14624 192.168.0.1:0/530794005", 2024-02-19T21:59:02.546 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "192.168.0.1:0/530794005", 2024-02-19T21:59:02.546 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2024-02-19T21:59:02.546 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 7, 2024-02-19T21:59:02.547 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 62, 2024-02-19T21:59:02.547 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2024-02-19T21:59:02.547 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklisted": false, 2024-02-19T21:59:02.547 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "foo" 2024-02-19T21:59:02.547 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-19T21:59:02.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-19T21:59:02.554 DEBUG:teuthology.orchestra.run.smithi099:> stat --file-system '--printf=%T 2024-02-19T21:59:02.554 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.0 2024-02-19T21:59:02.572 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2024-02-19T21:59:02.572 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-02-19T21:59:02.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-19T21:59:02.572 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-19T21:59:02.641 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-02-19T21:59:02.651 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-02-19T21:59:02.651 INFO:tasks.ceph_fuse:config is {'client.1': {'cephfs_name': 'bar'}} 2024-02-19T21:59:02.651 INFO:tasks.ceph_fuse:client.1 config is {'cephfs_name': 'bar'} 2024-02-19T21:59:02.651 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2024-02-19T21:59:02.651 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-02-19T21:59:02.651 DEBUG:teuthology.orchestra.run.smithi099:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-02-19T21:59:02.711 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:ceph-fuse[81385]: fuse finished with error 0 and tester_r 0 2024-02-19T21:59:02.713 INFO:teuthology.orchestra.run:waiting for 900 2024-02-19T21:59:02.795 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-02-19T21:59:02.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:02.795 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-19T21:59:02.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:02.826 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-02-19T21:59:02.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:02.850 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2024-02-19T21:59:02.928 INFO:teuthology.orchestra.run.smithi138.stderr:Cannot find device "ceph-brx" 2024-02-19T21:59:02.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T21:59:02.929 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-02-19T21:59:02.929 DEBUG:teuthology.orchestra.run.smithi138:> ceph fs ls 2024-02-19T21:59:03.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:01.920394+0000 mon.smithi099 (mon.0) 717 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:59:03.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:01.921567+0000 mon.smithi099 (mon.0) 718 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:59:03.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:01.922053+0000 mon.smithi099 (mon.0) 719 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:59:03.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:01.925715+0000 mon.smithi099 (mon.0) 720 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:59:03.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:01.920394+0000 mon.smithi099 (mon.0) 717 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T21:59:03.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:01.921567+0000 mon.smithi099 (mon.0) 718 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T21:59:03.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:01.922053+0000 mon.smithi099 (mon.0) 719 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T21:59:03.449 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:01.925715+0000 mon.smithi099 (mon.0) 720 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:59:03.450 INFO:teuthology.orchestra.run.smithi138.stdout:name: foo, metadata pool: cephfs.foo.meta, data pools: [cephfs.foo.data ] 2024-02-19T21:59:03.451 INFO:teuthology.orchestra.run.smithi138.stdout:name: bar, metadata pool: cephfs.bar.meta, data pools: [cephfs.bar.data ] 2024-02-19T21:59:03.451 INFO:tasks.cephfs.mount:Mounting Ceph FS bar; just confirmed its presence on cluster 2024-02-19T21:59:03.451 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-19T21:59:03.451 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2024-02-19T21:59:03.451 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-19T21:59:03.451 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-19T21:59:03.451 INFO:tasks.cephfs.mount:self.cephfs_name = bar 2024-02-19T21:59:03.451 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-19T21:59:03.451 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-19T21:59:03.451 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-19T21:59:03.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:03.452 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2024-02-19T21:59:03.470 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T21:59:03.470 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2024-02-19T21:59:03.471 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-19T21:59:03.472 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 41967sec preferred_lft 41967sec 2024-02-19T21:59:03.472 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2024-02-19T21:59:03.472 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-02-19T21:59:03.472 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-19T21:59:03.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:03.472 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-19T21:59:03.472 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-19T21:59:03.473 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add name ceph-brx type bridge 2024-02-19T21:59:03.473 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr flush dev ceph-brx 2024-02-19T21:59:03.473 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set ceph-brx up 2024-02-19T21:59:03.473 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-19T21:59:03.473 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-19T21:59:03.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:03.646 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-19T21:59:03.673 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-02-19T21:59:03.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:03.674 DEBUG:teuthology.orchestra.run.smithi138:> route 2024-02-19T21:59:03.752 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2024-02-19T21:59:03.753 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-19T21:59:03.753 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-19T21:59:03.753 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-19T21:59:03.753 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-19T21:59:03.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:03.753 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-19T21:59:03.753 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-19T21:59:03.753 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-19T21:59:03.754 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-19T21:59:03.754 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-19T21:59:03.754 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-19T21:59:04.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:04.048 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-02-19T21:59:04.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:04.066 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list-id 2024-02-19T21:59:04.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:04.124 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-19T21:59:04.124 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-19T21:59:04.124 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T21:59:04.124 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-19T21:59:04.125 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-19T21:59:04.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:02.377116+0000 mgr.smithi099.zfglya (mgr.14180) 277 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 4.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-02-19T21:59:04.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:03.362402+0000 mon.smithi138 (mon.1) 19 : audit [DBG] from='client.? 172.21.15.138:0/1663316558' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-19T21:59:04.203 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:02.377116+0000 mgr.smithi099.zfglya (mgr.14180) 277 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 4.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-02-19T21:59:04.203 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:03.362402+0000 mon.smithi138 (mon.1) 19 : audit [DBG] from='client.? 172.21.15.138:0/1663316558' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-19T21:59:04.219 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-19T21:59:04.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:04.219 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-19T21:59:04.219 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-19T21:59:04.219 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-19T21:59:04.219 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-19T21:59:04.219 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-19T21:59:04.219 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-19T21:59:04.220 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-19T21:59:04.220 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-19T21:59:04.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T21:59:04.479 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-19T21:59:04.479 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-19T21:59:04.479 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2024-02-19T21:59:04.479 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set dev brx.0 master ceph-brx 2024-02-19T21:59:04.479 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-19T21:59:04.577 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {'cephfs_name': 'bar'} 2024-02-19T21:59:04.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-19T21:59:04.577 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.1 2024-02-19T21:59:04.594 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-19T21:59:04.594 DEBUG:teuthology.orchestra.run.smithi138:> sudo modprobe fuse 2024-02-19T21:59:04.661 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-02-19T21:59:04.661 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-02-19T21:59:04.728 INFO:teuthology.orchestra.run.smithi138.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-02-19T21:59:04.729 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-02-19T21:59:04.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-19T21:59:04.729 DEBUG:teuthology.orchestra.run.smithi138:> ls /sys/fs/fuse/connections 2024-02-19T21:59:04.789 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-19T21:59:04.789 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 1 --client_fs=bar /home/ubuntu/cephtest/mnt.1 2024-02-19T21:59:04.831 DEBUG:teuthology.orchestra.run.smithi138:> sudo modprobe fuse 2024-02-19T21:59:04.858 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-02-19T21:59:04.858 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-02-19T21:59:04.924 INFO:teuthology.orchestra.run.smithi138.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-02-19T21:59:04.925 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-02-19T21:59:04.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-19T21:59:04.926 DEBUG:teuthology.orchestra.run.smithi138:> ls /sys/fs/fuse/connections 2024-02-19T21:59:04.937 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi138.stderr:2024-02-19T21:59:04.938+0000 7f559370c3c0 -1 init, newargv = 0x558dfe88cab0 newargc=15 2024-02-19T21:59:04.937 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi138.stderr:ceph-fuse[62707]: starting ceph client 2024-02-19T21:59:04.942 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi138.stderr:ceph-fuse[62707]: starting fuse 2024-02-19T21:59:04.955 INFO:teuthology.orchestra.run.smithi138.stdout:129 2024-02-19T21:59:04.955 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-02-19T21:59:04.955 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-02-19T21:59:04.955 DEBUG:teuthology.orchestra.run.smithi138:> import glob 2024-02-19T21:59:04.955 DEBUG:teuthology.orchestra.run.smithi138:> import re 2024-02-19T21:59:04.955 DEBUG:teuthology.orchestra.run.smithi138:> import os 2024-02-19T21:59:04.955 DEBUG:teuthology.orchestra.run.smithi138:> import subprocess 2024-02-19T21:59:04.955 DEBUG:teuthology.orchestra.run.smithi138:> 2024-02-19T21:59:04.955 DEBUG:teuthology.orchestra.run.smithi138:> def _find_admin_socket(client_name): 2024-02-19T21:59:04.955 DEBUG:teuthology.orchestra.run.smithi138:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> files = glob.glob(asok_path) 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> # Given a non-glob path, it better be there 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> if "*" not in asok_path: 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> assert(len(files) == 1) 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> return files[0] 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> for f in files: 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> contents = proc_f.read() 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> if mountpoint in contents: 2024-02-19T21:59:04.956 DEBUG:teuthology.orchestra.run.smithi138:> return f 2024-02-19T21:59:04.957 DEBUG:teuthology.orchestra.run.smithi138:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-19T21:59:04.957 DEBUG:teuthology.orchestra.run.smithi138:> 2024-02-19T21:59:04.957 DEBUG:teuthology.orchestra.run.smithi138:> print(_find_admin_socket("client.1")) 2024-02-19T21:59:04.957 DEBUG:teuthology.orchestra.run.smithi138:> ' 2024-02-19T21:59:05.078 INFO:teuthology.orchestra.run.smithi138.stdout:/var/run/ceph/ceph-client.1.62707.asok 2024-02-19T21:59:05.261 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.62707.asok 2024-02-19T21:59:05.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-19T21:59:05.261 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.62707.asok status 2024-02-19T21:59:05.411 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-19T21:59:05.412 INFO:teuthology.orchestra.run.smithi138.stdout: "metadata": { 2024-02-19T21:59:05.412 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_sha1": "81bd20d634209c7cb82c18be12b4b5a05643ebf1", 2024-02-19T21:59:05.412 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_version": "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)", 2024-02-19T21:59:05.412 INFO:teuthology.orchestra.run.smithi138.stdout: "entity_id": "1", 2024-02-19T21:59:05.412 INFO:teuthology.orchestra.run.smithi138.stdout: "hostname": "smithi138", 2024-02-19T21:59:05.412 INFO:teuthology.orchestra.run.smithi138.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-02-19T21:59:05.412 INFO:teuthology.orchestra.run.smithi138.stdout: "pid": "62707", 2024-02-19T21:59:05.412 INFO:teuthology.orchestra.run.smithi138.stdout: "root": "/" 2024-02-19T21:59:05.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-19T21:59:05.412 INFO:teuthology.orchestra.run.smithi138.stdout: "dentry_count": 0, 2024-02-19T21:59:05.413 INFO:teuthology.orchestra.run.smithi138.stdout: "dentry_pinned_count": 0, 2024-02-19T21:59:05.413 INFO:teuthology.orchestra.run.smithi138.stdout: "id": 24385, 2024-02-19T21:59:05.413 INFO:teuthology.orchestra.run.smithi138.stdout: "inst": { 2024-02-19T21:59:05.413 INFO:teuthology.orchestra.run.smithi138.stdout: "name": { 2024-02-19T21:59:05.413 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "client", 2024-02-19T21:59:05.413 INFO:teuthology.orchestra.run.smithi138.stdout: "num": 24385 2024-02-19T21:59:05.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-19T21:59:05.413 INFO:teuthology.orchestra.run.smithi138.stdout: "addr": { 2024-02-19T21:59:05.413 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "v1", 2024-02-19T21:59:05.413 INFO:teuthology.orchestra.run.smithi138.stdout: "addr": "192.168.0.1:0", 2024-02-19T21:59:05.413 INFO:teuthology.orchestra.run.smithi138.stdout: "nonce": 3154002181 2024-02-19T21:59:05.413 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-19T21:59:05.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-19T21:59:05.413 INFO:teuthology.orchestra.run.smithi138.stdout: "addr": { 2024-02-19T21:59:05.414 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "v1", 2024-02-19T21:59:05.414 INFO:teuthology.orchestra.run.smithi138.stdout: "addr": "192.168.0.1:0", 2024-02-19T21:59:05.414 INFO:teuthology.orchestra.run.smithi138.stdout: "nonce": 3154002181 2024-02-19T21:59:05.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-19T21:59:05.414 INFO:teuthology.orchestra.run.smithi138.stdout: "inst_str": "client.24385 192.168.0.1:0/3154002181", 2024-02-19T21:59:05.414 INFO:teuthology.orchestra.run.smithi138.stdout: "addr_str": "192.168.0.1:0/3154002181", 2024-02-19T21:59:05.414 INFO:teuthology.orchestra.run.smithi138.stdout: "inode_count": 1, 2024-02-19T21:59:05.414 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_epoch": 11, 2024-02-19T21:59:05.414 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_epoch": 62, 2024-02-19T21:59:05.414 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_epoch_barrier": 0, 2024-02-19T21:59:05.414 INFO:teuthology.orchestra.run.smithi138.stdout: "blocklisted": false, 2024-02-19T21:59:05.414 INFO:teuthology.orchestra.run.smithi138.stdout: "fs_name": "bar" 2024-02-19T21:59:05.414 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-19T21:59:05.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-19T21:59:05.422 DEBUG:teuthology.orchestra.run.smithi138:> stat --file-system '--printf=%T 2024-02-19T21:59:05.423 DEBUG:teuthology.orchestra.run.smithi138:> ' -- /home/ubuntu/cephtest/mnt.1 2024-02-19T21:59:05.440 INFO:teuthology.orchestra.run.smithi138.stdout:fuseblk 2024-02-19T21:59:05.440 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-02-19T21:59:05.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-19T21:59:05.441 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-19T21:59:05.510 INFO:teuthology.run_tasks:Running task workunit... 2024-02-19T21:59:05.523 INFO:tasks.workunit:Pulling workunits from ref 81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:59:05.524 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-19T21:59:05.524 INFO:tasks.workunit:timeout=3h 2024-02-19T21:59:05.524 INFO:tasks.workunit:cleanup=True 2024-02-19T21:59:05.524 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-19T21:59:05.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T21:59:05.547 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-02-19T21:59:05.547 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-02-19T21:59:05.612 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-02-19T21:59:05.613 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-02-19T21:59:05.674 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-19T21:59:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-19T21:59:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-19T21:59:05.694 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 81h/129d Inode: 1 Links: 2 2024-02-19T21:59:05.694 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T21:59:05.694 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-19T21:59:05.694 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-19T21:59:05.694 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-19 21:58:45.678040319 +0000 2024-02-19T21:59:05.694 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-19 21:59:05.509450365 +0000 2024-02-19T21:59:05.694 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-02-19T21:59:05.695 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-19T21:59:05.695 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-19T21:59:05.766 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:59:05.766 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-19T21:59:05.789 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-19T21:59:05.824 INFO:tasks.workunit.client.1.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-19T21:59:06.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:04.377583+0000 mgr.smithi099.zfglya (mgr.14180) 278 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 4.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-02-19T21:59:06.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:04.377583+0000 mgr.smithi099.zfglya (mgr.14180) 278 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 4.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 5.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-02-19T21:59:08.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:06.378168+0000 mgr.smithi099.zfglya (mgr.14180) 279 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 5.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 267 B/s wr, 4 op/s 2024-02-19T21:59:08.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:06.378168+0000 mgr.smithi099.zfglya (mgr.14180) 279 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 5.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 267 B/s wr, 4 op/s 2024-02-19T21:59:10.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:08.378729+0000 mgr.smithi099.zfglya (mgr.14180) 280 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 5.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-19T21:59:10.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:09.454914+0000 mon.smithi099 (mon.0) 721 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:59:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:08.378729+0000 mgr.smithi099.zfglya (mgr.14180) 280 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 5.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-19T21:59:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:09.454914+0000 mon.smithi099 (mon.0) 721 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T21:59:12.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:10.379221+0000 mgr.smithi099.zfglya (mgr.14180) 281 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 9.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 682 B/s wr, 3 op/s 2024-02-19T21:59:12.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:10.379221+0000 mgr.smithi099.zfglya (mgr.14180) 281 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 9.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 682 B/s wr, 3 op/s 2024-02-19T21:59:14.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:12.379671+0000 mgr.smithi099.zfglya (mgr.14180) 282 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 9.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-19T21:59:14.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:12.379671+0000 mgr.smithi099.zfglya (mgr.14180) 282 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 9.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-19T21:59:16.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:14.380061+0000 mgr.smithi099.zfglya (mgr.14180) 283 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 9.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s wr, 0 op/s 2024-02-19T21:59:16.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:14.380061+0000 mgr.smithi099.zfglya (mgr.14180) 283 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 9.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s wr, 0 op/s 2024-02-19T21:59:18.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:16.380646+0000 mgr.smithi099.zfglya (mgr.14180) 284 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 9.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s wr, 0 op/s 2024-02-19T21:59:18.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:16.380646+0000 mgr.smithi099.zfglya (mgr.14180) 284 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 9.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 682 B/s wr, 0 op/s 2024-02-19T21:59:20.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:18.381077+0000 mgr.smithi099.zfglya (mgr.14180) 285 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 9.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 597 B/s wr, 0 op/s 2024-02-19T21:59:20.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:18.381077+0000 mgr.smithi099.zfglya (mgr.14180) 285 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 9.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 597 B/s wr, 0 op/s 2024-02-19T21:59:22.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:20.381562+0000 mgr.smithi099.zfglya (mgr.14180) 286 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s wr, 0 op/s 2024-02-19T21:59:22.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:20.381562+0000 mgr.smithi099.zfglya (mgr.14180) 286 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s wr, 0 op/s 2024-02-19T21:59:24.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:22.382000+0000 mgr.smithi099.zfglya (mgr.14180) 287 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 341 B/s wr, 0 op/s 2024-02-19T21:59:24.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:22.382000+0000 mgr.smithi099.zfglya (mgr.14180) 287 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 341 B/s wr, 0 op/s 2024-02-19T21:59:25.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:24.332115+0000 mon.smithi099 (mon.0) 722 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-02-19T21:59:25.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:24.332314+0000 mon.smithi099 (mon.0) 723 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-19T21:59:25.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:24.332598+0000 mon.smithi099 (mon.0) 724 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-19T21:59:25.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:24.332830+0000 mon.smithi099 (mon.0) 725 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-19T21:59:25.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:24.332115+0000 mon.smithi099 (mon.0) 722 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-02-19T21:59:25.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:24.332314+0000 mon.smithi099 (mon.0) 723 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-19T21:59:25.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:24.332598+0000 mon.smithi099 (mon.0) 724 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-19T21:59:25.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:24.332830+0000 mon.smithi099 (mon.0) 725 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-19T21:59:26.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:24.382478+0000 mgr.smithi099.zfglya (mgr.14180) 288 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-02-19T21:59:26.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:24.967476+0000 mon.smithi099 (mon.0) 726 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2024-02-19T21:59:26.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:24.967542+0000 mon.smithi099 (mon.0) 727 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-02-19T21:59:26.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:24.967596+0000 mon.smithi099 (mon.0) 728 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]': finished 2024-02-19T21:59:26.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T21:59:24.967641+0000 mon.smithi099 (mon.0) 729 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-02-19T21:59:26.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:24.967680+0000 mon.smithi099 (mon.0) 730 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-19T21:59:26.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:24.382478+0000 mgr.smithi099.zfglya (mgr.14180) 288 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-02-19T21:59:26.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:24.967476+0000 mon.smithi099 (mon.0) 726 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2024-02-19T21:59:26.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:24.967542+0000 mon.smithi099 (mon.0) 727 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-02-19T21:59:26.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:24.967596+0000 mon.smithi099 (mon.0) 728 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]': finished 2024-02-19T21:59:26.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T21:59:24.967641+0000 mon.smithi099 (mon.0) 729 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-02-19T21:59:26.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:24.967680+0000 mon.smithi099 (mon.0) 730 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-19T21:59:27.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:25.968666+0000 mon.smithi099 (mon.0) 731 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-19T21:59:27.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:25.968666+0000 mon.smithi099 (mon.0) 731 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-19T21:59:28.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:26.382919+0000 mgr.smithi099.zfglya (mgr.14180) 289 : cluster [DBG] pgmap v264: 129 pgs: 3 peering, 126 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:59:28.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:26.382919+0000 mgr.smithi099.zfglya (mgr.14180) 289 : cluster [DBG] pgmap v264: 129 pgs: 3 peering, 126 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:59:30.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:28.383450+0000 mgr.smithi099.zfglya (mgr.14180) 290 : cluster [DBG] pgmap v265: 129 pgs: 3 peering, 126 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:59:30.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:28.383450+0000 mgr.smithi099.zfglya (mgr.14180) 290 : cluster [DBG] pgmap v265: 129 pgs: 3 peering, 126 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:59:32.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:30.384048+0000 mgr.smithi099.zfglya (mgr.14180) 291 : cluster [DBG] pgmap v266: 129 pgs: 2 peering, 127 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 796 B/s, 0 objects/s recovering 2024-02-19T21:59:32.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:30.384048+0000 mgr.smithi099.zfglya (mgr.14180) 291 : cluster [DBG] pgmap v266: 129 pgs: 2 peering, 127 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 796 B/s, 0 objects/s recovering 2024-02-19T21:59:34.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:32.384532+0000 mgr.smithi099.zfglya (mgr.14180) 292 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 799 B/s, 0 objects/s recovering 2024-02-19T21:59:34.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:32.384532+0000 mgr.smithi099.zfglya (mgr.14180) 292 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 799 B/s, 0 objects/s recovering 2024-02-19T21:59:36.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:34.385033+0000 mgr.smithi099.zfglya (mgr.14180) 293 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 678 B/s, 0 objects/s recovering 2024-02-19T21:59:36.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:34.385033+0000 mgr.smithi099.zfglya (mgr.14180) 293 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 678 B/s, 0 objects/s recovering 2024-02-19T21:59:38.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:36.385523+0000 mgr.smithi099.zfglya (mgr.14180) 294 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 98 B/s rd, 98 B/s wr, 0 op/s; 613 B/s, 0 objects/s recovering 2024-02-19T21:59:38.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:36.385523+0000 mgr.smithi099.zfglya (mgr.14180) 294 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 98 B/s rd, 98 B/s wr, 0 op/s; 613 B/s, 0 objects/s recovering 2024-02-19T21:59:40.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:38.386032+0000 mgr.smithi099.zfglya (mgr.14180) 295 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 85 B/s rd, 85 B/s wr, 0 op/s; 532 B/s, 0 objects/s recovering 2024-02-19T21:59:40.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:38.386032+0000 mgr.smithi099.zfglya (mgr.14180) 295 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 85 B/s rd, 85 B/s wr, 0 op/s; 532 B/s, 0 objects/s recovering 2024-02-19T21:59:42.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:40.386619+0000 mgr.smithi099.zfglya (mgr.14180) 296 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 85 B/s rd, 85 B/s wr, 0 op/s; 532 B/s, 0 objects/s recovering 2024-02-19T21:59:42.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:40.386619+0000 mgr.smithi099.zfglya (mgr.14180) 296 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 85 B/s rd, 85 B/s wr, 0 op/s; 532 B/s, 0 objects/s recovering 2024-02-19T21:59:44.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:42.387170+0000 mgr.smithi099.zfglya (mgr.14180) 297 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 85 B/s rd, 85 B/s wr, 0 op/s; 1 B/s, 0 objects/s recovering 2024-02-19T21:59:44.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:42.387170+0000 mgr.smithi099.zfglya (mgr.14180) 297 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 85 B/s rd, 85 B/s wr, 0 op/s; 1 B/s, 0 objects/s recovering 2024-02-19T21:59:46.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:44.387658+0000 mgr.smithi099.zfglya (mgr.14180) 298 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:59:46.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:44.387658+0000 mgr.smithi099.zfglya (mgr.14180) 298 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:59:48.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:46.388186+0000 mgr.smithi099.zfglya (mgr.14180) 299 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:59:48.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:46.388186+0000 mgr.smithi099.zfglya (mgr.14180) 299 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:59:50.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:48.388590+0000 mgr.smithi099.zfglya (mgr.14180) 300 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:59:50.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:48.388590+0000 mgr.smithi099.zfglya (mgr.14180) 300 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:59:50.784 INFO:tasks.workunit.client.1.smithi138.stderr:Note: switching to '81bd20d634209c7cb82c18be12b4b5a05643ebf1'. 2024-02-19T21:59:50.784 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-02-19T21:59:50.785 INFO:tasks.workunit.client.1.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-19T21:59:50.785 INFO:tasks.workunit.client.1.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-19T21:59:50.785 INFO:tasks.workunit.client.1.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-02-19T21:59:50.785 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-02-19T21:59:50.785 INFO:tasks.workunit.client.1.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-19T21:59:50.785 INFO:tasks.workunit.client.1.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-19T21:59:50.785 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-02-19T21:59:50.785 INFO:tasks.workunit.client.1.smithi138.stderr: git switch -c 2024-02-19T21:59:50.785 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-02-19T21:59:50.785 INFO:tasks.workunit.client.1.smithi138.stderr:Or undo this operation with: 2024-02-19T21:59:50.785 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-02-19T21:59:50.786 INFO:tasks.workunit.client.1.smithi138.stderr: git switch - 2024-02-19T21:59:50.786 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-02-19T21:59:50.786 INFO:tasks.workunit.client.1.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-19T21:59:50.786 INFO:tasks.workunit.client.1.smithi138.stderr: 2024-02-19T21:59:50.786 INFO:tasks.workunit.client.1.smithi138.stderr:HEAD is now at 81bd20d6342 Merge pull request #55523 from ljflores/wip-tracker-64343-pacific 2024-02-19T21:59:50.790 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-19T21:59:50.855 INFO:tasks.workunit.client.1.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-19T21:59:50.857 INFO:tasks.workunit.client.1.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-19T21:59:50.857 INFO:tasks.workunit.client.1.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-19T21:59:51.393 INFO:tasks.workunit.client.1.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-19T21:59:51.453 INFO:tasks.workunit.client.1.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-19T21:59:51.490 INFO:tasks.workunit.client.1.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-19T21:59:51.492 INFO:tasks.workunit.client.1.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-19T21:59:51.492 INFO:tasks.workunit.client.1.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-19T21:59:51.528 INFO:tasks.workunit.client.1.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-19T21:59:51.531 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-19T21:59:51.531 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-19T21:59:51.589 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.1... 2024-02-19T21:59:51.591 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-02-19T21:59:51.591 DEBUG:teuthology.orchestra.run.smithi138:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=81bd20d634209c7cb82c18be12b4b5a05643ebf1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/dbench.sh 2024-02-19T21:59:51.661 INFO:tasks.workunit.client.1.smithi138.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-02-19T21:59:51.661 INFO:tasks.workunit.client.1.smithi138.stdout: 2024-02-19T21:59:51.661 INFO:tasks.workunit.client.1.smithi138.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-02-19T21:59:51.668 INFO:tasks.workunit.client.1.smithi138.stdout:0 of 1 processes prepared for launch 0 sec 2024-02-19T21:59:51.768 INFO:tasks.workunit.client.1.smithi138.stdout:1 of 1 processes prepared for launch 0 sec 2024-02-19T21:59:51.768 INFO:tasks.workunit.client.1.smithi138.stdout:releasing clients 2024-02-19T21:59:52.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:50.389179+0000 mgr.smithi099.zfglya (mgr.14180) 301 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:59:52.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:50.389179+0000 mgr.smithi099.zfglya (mgr.14180) 301 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 11 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-19T21:59:52.768 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1961 26.45 MB/sec warmup 1 sec latency 4.361 ms 2024-02-19T21:59:53.549 INFO:tasks.workunit.client.0.smithi099.stderr:Updating files: 91% (11090/12088) Updating files: 92% (11121/12088) Updating files: 93% (11242/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-02-19T21:59:53.768 INFO:tasks.workunit.client.1.smithi138.stdout: 1 3819 19.88 MB/sec warmup 2 sec latency 4.803 ms 2024-02-19T21:59:54.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:52.389671+0000 mgr.smithi099.zfglya (mgr.14180) 302 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 1.8 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 154 KiB/s wr, 0 op/s 2024-02-19T21:59:54.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:52.389671+0000 mgr.smithi099.zfglya (mgr.14180) 302 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 1.8 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 154 KiB/s wr, 0 op/s 2024-02-19T21:59:54.582 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to '81bd20d634209c7cb82c18be12b4b5a05643ebf1'. 2024-02-19T21:59:54.582 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-19T21:59:54.582 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-19T21:59:54.582 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-19T21:59:54.582 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-02-19T21:59:54.583 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-19T21:59:54.583 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-19T21:59:54.583 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-19T21:59:54.583 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-19T21:59:54.583 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-02-19T21:59:54.583 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-19T21:59:54.583 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-02-19T21:59:54.583 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-19T21:59:54.583 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-02-19T21:59:54.583 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-19T21:59:54.583 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-19T21:59:54.583 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-19T21:59:54.583 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at 81bd20d6342 Merge pull request #55523 from ljflores/wip-tracker-64343-pacific 2024-02-19T21:59:54.588 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-19T21:59:54.663 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-19T21:59:54.665 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-19T21:59:54.665 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-19T21:59:54.768 INFO:tasks.workunit.client.1.smithi138.stdout: 1 5422 15.16 MB/sec warmup 3 sec latency 3.775 ms 2024-02-19T21:59:55.206 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-19T21:59:55.267 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-19T21:59:55.306 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-19T21:59:55.308 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-19T21:59:55.308 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-19T21:59:55.349 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-19T21:59:55.352 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-19T21:59:55.352 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-19T21:59:55.411 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-02-19T21:59:55.412 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-02-19T21:59:55.413 DEBUG:teuthology.orchestra.run.smithi099:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=81bd20d634209c7cb82c18be12b4b5a05643ebf1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-02-19T21:59:55.502 INFO:tasks.workunit.client.0.smithi099.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-02-19T21:59:55.502 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-02-19T21:59:55.502 INFO:tasks.workunit.client.0.smithi099.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-02-19T21:59:55.505 INFO:tasks.workunit.client.0.smithi099.stdout:0 of 1 processes prepared for launch 0 sec 2024-02-19T21:59:55.606 INFO:tasks.workunit.client.0.smithi099.stdout:1 of 1 processes prepared for launch 0 sec 2024-02-19T21:59:55.606 INFO:tasks.workunit.client.0.smithi099.stdout:releasing clients 2024-02-19T21:59:55.768 INFO:tasks.workunit.client.1.smithi138.stdout: 1 7324 14.72 MB/sec warmup 4 sec latency 3.882 ms 2024-02-19T21:59:56.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:54.390145+0000 mgr.smithi099.zfglya (mgr.14180) 303 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 10 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 944 KiB/s wr, 20 op/s 2024-02-19T21:59:56.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:54.390145+0000 mgr.smithi099.zfglya (mgr.14180) 303 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 10 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 944 KiB/s wr, 20 op/s 2024-02-19T21:59:56.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 3318 35.37 MB/sec warmup 1 sec latency 25.145 ms 2024-02-19T21:59:56.768 INFO:tasks.workunit.client.1.smithi138.stdout: 1 8881 12.90 MB/sec warmup 5 sec latency 7.645 ms 2024-02-19T21:59:57.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 6477 26.30 MB/sec warmup 2 sec latency 55.336 ms 2024-02-19T21:59:57.768 INFO:tasks.workunit.client.1.smithi138.stdout: 1 10781 12.83 MB/sec warmup 6 sec latency 6.987 ms 2024-02-19T21:59:58.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 21:59:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:56.390614+0000 mgr.smithi099.zfglya (mgr.14180) 304 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 23 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.2 MiB/s wr, 36 op/s 2024-02-19T21:59:58.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 21:59:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:56.390614+0000 mgr.smithi099.zfglya (mgr.14180) 304 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 23 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.2 MiB/s wr, 36 op/s 2024-02-19T21:59:58.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 9480 22.07 MB/sec warmup 3 sec latency 33.718 ms 2024-02-19T21:59:58.768 INFO:tasks.workunit.client.1.smithi138.stdout: 1 12308 11.94 MB/sec warmup 7 sec latency 7.441 ms 2024-02-19T21:59:59.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 12542 20.93 MB/sec warmup 4 sec latency 33.160 ms 2024-02-19T21:59:59.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 14259 12.00 MB/sec warmup 8 sec latency 11.243 ms 2024-02-19T22:00:00.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T21:59:58.391029+0000 mgr.smithi099.zfglya (mgr.14180) 305 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 24 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 2.5 MiB/s wr, 44 op/s 2024-02-19T22:00:00.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:00.000117+0000 mon.smithi099 (mon.0) 732 : cluster [INF] overall HEALTH_OK 2024-02-19T22:00:00.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T21:59:58.391029+0000 mgr.smithi099.zfglya (mgr.14180) 305 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 24 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 2.5 MiB/s wr, 44 op/s 2024-02-19T22:00:00.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:00.000117+0000 mon.smithi099 (mon.0) 732 : cluster [INF] overall HEALTH_OK 2024-02-19T22:00:00.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 15188 19.68 MB/sec warmup 5 sec latency 56.973 ms 2024-02-19T22:00:00.768 INFO:tasks.workunit.client.1.smithi138.stdout: 1 15756 11.40 MB/sec warmup 9 sec latency 7.557 ms 2024-02-19T22:00:01.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 18427 19.46 MB/sec warmup 6 sec latency 234.960 ms 2024-02-19T22:00:01.768 INFO:tasks.workunit.client.1.smithi138.stdout: 1 17558 11.19 MB/sec warmup 10 sec latency 6.316 ms 2024-02-19T22:00:02.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:00.391501+0000 mgr.smithi099.zfglya (mgr.14180) 306 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 29 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 3.8 MiB/s wr, 106 op/s 2024-02-19T22:00:02.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:00:01.931234+0000 mon.smithi099 (mon.0) 733 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:00:02.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:00.391501+0000 mgr.smithi099.zfglya (mgr.14180) 306 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 29 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 3.8 MiB/s wr, 106 op/s 2024-02-19T22:00:02.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:00:01.931234+0000 mon.smithi099 (mon.0) 733 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:00:02.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 21084 18.72 MB/sec warmup 7 sec latency 207.093 ms 2024-02-19T22:00:02.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 19133 11.05 MB/sec warmup 11 sec latency 8.557 ms 2024-02-19T22:00:03.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:00:02.273034+0000 mon.smithi099 (mon.0) 734 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:00:03.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:00:02.273700+0000 mon.smithi099 (mon.0) 735 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:00:03.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:00:02.277663+0000 mon.smithi099 (mon.0) 736 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:00:03.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:00:02.273034+0000 mon.smithi099 (mon.0) 734 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:00:03.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:00:02.273700+0000 mon.smithi099 (mon.0) 735 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:00:03.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:00:02.277663+0000 mon.smithi099 (mon.0) 736 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:00:03.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 24245 18.53 MB/sec warmup 8 sec latency 59.601 ms 2024-02-19T22:00:03.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 21087 10.92 MB/sec warmup 12 sec latency 14.519 ms 2024-02-19T22:00:04.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:02.391934+0000 mgr.smithi099.zfglya (mgr.14180) 307 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 32 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 4.7 MiB/s wr, 156 op/s 2024-02-19T22:00:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:02.391934+0000 mgr.smithi099.zfglya (mgr.14180) 307 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 32 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 4.7 MiB/s wr, 156 op/s 2024-02-19T22:00:04.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 27292 18.00 MB/sec warmup 9 sec latency 28.035 ms 2024-02-19T22:00:04.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 22512 10.60 MB/sec warmup 13 sec latency 6.528 ms 2024-02-19T22:00:05.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 30309 17.94 MB/sec warmup 10 sec latency 50.082 ms 2024-02-19T22:00:05.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 24600 10.72 MB/sec warmup 14 sec latency 12.790 ms 2024-02-19T22:00:06.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:04.392360+0000 mgr.smithi099.zfglya (mgr.14180) 308 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 34 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 5.1 MiB/s wr, 166 op/s 2024-02-19T22:00:06.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:04.392360+0000 mgr.smithi099.zfglya (mgr.14180) 308 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 34 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 5.1 MiB/s wr, 166 op/s 2024-02-19T22:00:06.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 32957 17.64 MB/sec warmup 11 sec latency 38.814 ms 2024-02-19T22:00:06.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 26009 10.46 MB/sec warmup 15 sec latency 6.826 ms 2024-02-19T22:00:07.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 36391 17.74 MB/sec warmup 12 sec latency 48.465 ms 2024-02-19T22:00:07.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 28041 10.50 MB/sec warmup 16 sec latency 6.190 ms 2024-02-19T22:00:08.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:06.392992+0000 mgr.smithi099.zfglya (mgr.14180) 309 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 33 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 4.9 MiB/s wr, 170 op/s 2024-02-19T22:00:08.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:06.392992+0000 mgr.smithi099.zfglya (mgr.14180) 309 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 33 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.4 KiB/s rd, 4.9 MiB/s wr, 170 op/s 2024-02-19T22:00:08.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 39858 17.83 MB/sec warmup 13 sec latency 41.761 ms 2024-02-19T22:00:08.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 29471 10.35 MB/sec warmup 17 sec latency 7.384 ms 2024-02-19T22:00:09.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 43337 17.91 MB/sec warmup 14 sec latency 33.736 ms 2024-02-19T22:00:09.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 31401 10.36 MB/sec warmup 18 sec latency 9.586 ms 2024-02-19T22:00:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:08.393386+0000 mgr.smithi099.zfglya (mgr.14180) 310 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 35 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.7 KiB/s rd, 4.2 MiB/s wr, 206 op/s 2024-02-19T22:00:10.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:08.393386+0000 mgr.smithi099.zfglya (mgr.14180) 310 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 35 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.7 KiB/s rd, 4.2 MiB/s wr, 206 op/s 2024-02-19T22:00:10.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 46882 17.99 MB/sec warmup 15 sec latency 33.644 ms 2024-02-19T22:00:10.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 32916 10.21 MB/sec warmup 19 sec latency 8.373 ms 2024-02-19T22:00:11.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 50372 18.06 MB/sec warmup 16 sec latency 47.085 ms 2024-02-19T22:00:11.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 34858 10.25 MB/sec warmup 20 sec latency 7.463 ms 2024-02-19T22:00:12.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:10.393863+0000 mgr.smithi099.zfglya (mgr.14180) 311 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 36 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 221 op/s 2024-02-19T22:00:12.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:10.393863+0000 mgr.smithi099.zfglya (mgr.14180) 311 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 36 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 221 op/s 2024-02-19T22:00:12.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 53913 18.12 MB/sec warmup 17 sec latency 33.652 ms 2024-02-19T22:00:12.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 36391 10.14 MB/sec warmup 21 sec latency 6.515 ms 2024-02-19T22:00:13.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 56539 17.90 MB/sec warmup 18 sec latency 49.048 ms 2024-02-19T22:00:13.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 38125 10.02 MB/sec warmup 22 sec latency 7.352 ms 2024-02-19T22:00:14.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:12.394300+0000 mgr.smithi099.zfglya (mgr.14180) 312 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 37 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.7 KiB/s rd, 4.3 MiB/s wr, 218 op/s 2024-02-19T22:00:14.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:12.394300+0000 mgr.smithi099.zfglya (mgr.14180) 312 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 37 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.7 KiB/s rd, 4.3 MiB/s wr, 218 op/s 2024-02-19T22:00:14.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 60073 17.96 MB/sec warmup 19 sec latency 27.687 ms 2024-02-19T22:00:14.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 39845 10.08 MB/sec warmup 23 sec latency 7.439 ms 2024-02-19T22:00:15.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 63248 17.93 MB/sec warmup 20 sec latency 49.901 ms 2024-02-19T22:00:15.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 41606 9.97 MB/sec warmup 24 sec latency 9.405 ms 2024-02-19T22:00:16.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:14.394701+0000 mgr.smithi099.zfglya (mgr.14180) 313 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 38 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 181 op/s 2024-02-19T22:00:16.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:14.394701+0000 mgr.smithi099.zfglya (mgr.14180) 313 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 38 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 181 op/s 2024-02-19T22:00:16.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 66248 17.72 MB/sec warmup 21 sec latency 43.629 ms 2024-02-19T22:00:16.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 43217 10.02 MB/sec warmup 25 sec latency 10.757 ms 2024-02-19T22:00:17.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 68158 17.48 MB/sec warmup 22 sec latency 271.344 ms 2024-02-19T22:00:17.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 45030 9.91 MB/sec warmup 26 sec latency 3.680 ms 2024-02-19T22:00:18.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:16.395159+0000 mgr.smithi099.zfglya (mgr.14180) 314 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 40 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 224 op/s 2024-02-19T22:00:18.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:16.395159+0000 mgr.smithi099.zfglya (mgr.14180) 314 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 40 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 224 op/s 2024-02-19T22:00:18.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 71646 17.55 MB/sec warmup 23 sec latency 87.446 ms 2024-02-19T22:00:18.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 46700 9.98 MB/sec warmup 27 sec latency 9.299 ms 2024-02-19T22:00:19.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 75220 17.62 MB/sec warmup 24 sec latency 47.199 ms 2024-02-19T22:00:19.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 48510 9.88 MB/sec warmup 28 sec latency 10.741 ms 2024-02-19T22:00:20.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:18.395509+0000 mgr.smithi099.zfglya (mgr.14180) 315 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 40 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.3 KiB/s rd, 3.9 MiB/s wr, 211 op/s 2024-02-19T22:00:20.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:18.395509+0000 mgr.smithi099.zfglya (mgr.14180) 315 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 40 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 9.3 KiB/s rd, 3.9 MiB/s wr, 211 op/s 2024-02-19T22:00:20.606 INFO:tasks.workunit.client.0.smithi099.stdout: 1 77870 17.48 MB/sec warmup 25 sec latency 26.427 ms 2024-02-19T22:00:20.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 50158 9.95 MB/sec warmup 29 sec latency 7.623 ms 2024-02-19T22:00:21.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 81280 17.50 MB/sec warmup 26 sec latency 44.813 ms 2024-02-19T22:00:21.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 51893 9.82 MB/sec warmup 30 sec latency 11.640 ms 2024-02-19T22:00:22.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:20.396023+0000 mgr.smithi099.zfglya (mgr.14180) 316 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 40 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 178 op/s 2024-02-19T22:00:22.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:20.396023+0000 mgr.smithi099.zfglya (mgr.14180) 316 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 40 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 178 op/s 2024-02-19T22:00:22.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 84554 17.53 MB/sec warmup 27 sec latency 27.960 ms 2024-02-19T22:00:22.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 53655 9.93 MB/sec warmup 31 sec latency 4.682 ms 2024-02-19T22:00:23.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 85860 17.15 MB/sec warmup 28 sec latency 190.134 ms 2024-02-19T22:00:23.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 55300 9.80 MB/sec warmup 32 sec latency 12.197 ms 2024-02-19T22:00:24.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:22.396472+0000 mgr.smithi099.zfglya (mgr.14180) 317 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 43 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.6 KiB/s rd, 4.3 MiB/s wr, 227 op/s 2024-02-19T22:00:24.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:22.396472+0000 mgr.smithi099.zfglya (mgr.14180) 317 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 43 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.6 KiB/s rd, 4.3 MiB/s wr, 227 op/s 2024-02-19T22:00:24.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 85916 16.56 MB/sec warmup 29 sec latency 237.669 ms 2024-02-19T22:00:24.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 57095 9.90 MB/sec warmup 33 sec latency 4.204 ms 2024-02-19T22:00:25.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 85986 16.02 MB/sec warmup 30 sec latency 178.701 ms 2024-02-19T22:00:25.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 58689 9.78 MB/sec warmup 34 sec latency 8.587 ms 2024-02-19T22:00:26.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:24.396889+0000 mgr.smithi099.zfglya (mgr.14180) 318 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 42 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 179 op/s 2024-02-19T22:00:26.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:24.396889+0000 mgr.smithi099.zfglya (mgr.14180) 318 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 42 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 179 op/s 2024-02-19T22:00:26.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 87944 15.84 MB/sec warmup 31 sec latency 275.010 ms 2024-02-19T22:00:26.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 60587 9.88 MB/sec warmup 35 sec latency 6.450 ms 2024-02-19T22:00:27.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 91104 15.82 MB/sec warmup 32 sec latency 46.080 ms 2024-02-19T22:00:27.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 62189 9.76 MB/sec warmup 36 sec latency 7.740 ms 2024-02-19T22:00:28.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:26.397329+0000 mgr.smithi099.zfglya (mgr.14180) 319 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 42 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 186 op/s 2024-02-19T22:00:28.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:26.397329+0000 mgr.smithi099.zfglya (mgr.14180) 319 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 42 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 186 op/s 2024-02-19T22:00:28.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 94161 15.87 MB/sec warmup 33 sec latency 33.651 ms 2024-02-19T22:00:28.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 64099 9.86 MB/sec warmup 37 sec latency 5.245 ms 2024-02-19T22:00:29.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 97456 15.96 MB/sec warmup 34 sec latency 27.904 ms 2024-02-19T22:00:29.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 65661 9.75 MB/sec warmup 38 sec latency 4.485 ms 2024-02-19T22:00:30.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:28.397775+0000 mgr.smithi099.zfglya (mgr.14180) 320 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 45 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.8 MiB/s wr, 185 op/s 2024-02-19T22:00:30.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:28.397775+0000 mgr.smithi099.zfglya (mgr.14180) 320 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 45 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.8 MiB/s wr, 185 op/s 2024-02-19T22:00:30.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 100354 15.93 MB/sec warmup 35 sec latency 50.141 ms 2024-02-19T22:00:30.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 67537 9.82 MB/sec warmup 39 sec latency 9.786 ms 2024-02-19T22:00:31.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 103836 16.01 MB/sec warmup 36 sec latency 26.875 ms 2024-02-19T22:00:31.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 69067 9.74 MB/sec warmup 40 sec latency 4.383 ms 2024-02-19T22:00:32.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:30.398316+0000 mgr.smithi099.zfglya (mgr.14180) 321 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 48 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.4 KiB/s rd, 4.4 MiB/s wr, 195 op/s 2024-02-19T22:00:32.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:30.398316+0000 mgr.smithi099.zfglya (mgr.14180) 321 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 48 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.4 KiB/s rd, 4.4 MiB/s wr, 195 op/s 2024-02-19T22:00:32.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 107334 16.09 MB/sec warmup 37 sec latency 42.397 ms 2024-02-19T22:00:32.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 70990 9.80 MB/sec warmup 41 sec latency 13.111 ms 2024-02-19T22:00:33.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 110810 16.17 MB/sec warmup 38 sec latency 33.699 ms 2024-02-19T22:00:33.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 72524 9.73 MB/sec warmup 42 sec latency 7.031 ms 2024-02-19T22:00:34.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:32.398762+0000 mgr.smithi099.zfglya (mgr.14180) 322 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 51 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.5 KiB/s rd, 4.4 MiB/s wr, 239 op/s 2024-02-19T22:00:34.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:32.398762+0000 mgr.smithi099.zfglya (mgr.14180) 322 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 51 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.5 KiB/s rd, 4.4 MiB/s wr, 239 op/s 2024-02-19T22:00:34.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 114349 16.24 MB/sec warmup 39 sec latency 33.700 ms 2024-02-19T22:00:34.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 74386 9.72 MB/sec warmup 43 sec latency 6.722 ms 2024-02-19T22:00:35.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 117834 16.31 MB/sec warmup 40 sec latency 50.312 ms 2024-02-19T22:00:35.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 76031 9.72 MB/sec warmup 44 sec latency 8.505 ms 2024-02-19T22:00:36.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:34.399348+0000 mgr.smithi099.zfglya (mgr.14180) 323 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 50 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.2 MiB/s wr, 194 op/s 2024-02-19T22:00:36.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:34.399348+0000 mgr.smithi099.zfglya (mgr.14180) 323 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 50 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.2 MiB/s wr, 194 op/s 2024-02-19T22:00:36.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 121317 16.38 MB/sec warmup 41 sec latency 106.468 ms 2024-02-19T22:00:36.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 77876 9.71 MB/sec warmup 45 sec latency 11.800 ms 2024-02-19T22:00:37.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 121366 15.99 MB/sec warmup 42 sec latency 291.829 ms 2024-02-19T22:00:37.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 79486 9.71 MB/sec warmup 46 sec latency 7.091 ms 2024-02-19T22:00:38.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:36.399785+0000 mgr.smithi099.zfglya (mgr.14180) 324 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 50 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.1 MiB/s wr, 202 op/s 2024-02-19T22:00:38.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:36.399785+0000 mgr.smithi099.zfglya (mgr.14180) 324 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 50 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.1 MiB/s wr, 202 op/s 2024-02-19T22:00:38.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 123050 15.77 MB/sec warmup 43 sec latency 436.783 ms 2024-02-19T22:00:38.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 81394 9.70 MB/sec warmup 47 sec latency 24.523 ms 2024-02-19T22:00:39.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 126533 15.85 MB/sec warmup 44 sec latency 33.654 ms 2024-02-19T22:00:39.769 INFO:tasks.workunit.client.1.smithi138.stdout: 1 82822 9.64 MB/sec warmup 48 sec latency 4.069 ms 2024-02-19T22:00:40.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:38.400232+0000 mgr.smithi099.zfglya (mgr.14180) 325 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 51 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 3.9 MiB/s wr, 193 op/s 2024-02-19T22:00:40.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:38.400232+0000 mgr.smithi099.zfglya (mgr.14180) 325 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 51 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 3.9 MiB/s wr, 193 op/s 2024-02-19T22:00:40.856 INFO:tasks.workunit.client.0.smithi099.stdout: 1 129365 15.88 MB/sec warmup 45 sec latency 50.296 ms 2024-02-19T22:00:40.856 INFO:tasks.workunit.client.1.smithi138.stdout: 1 84845 9.68 MB/sec warmup 49 sec latency 11.816 ms 2024-02-19T22:00:41.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 132266 15.86 MB/sec warmup 46 sec latency 32.408 ms 2024-02-19T22:00:41.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 86249 9.64 MB/sec warmup 50 sec latency 7.145 ms 2024-02-19T22:00:42.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:40.400697+0000 mgr.smithi099.zfglya (mgr.14180) 326 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 55 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.5 MiB/s wr, 203 op/s 2024-02-19T22:00:42.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:40.400697+0000 mgr.smithi099.zfglya (mgr.14180) 326 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 55 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.5 MiB/s wr, 203 op/s 2024-02-19T22:00:42.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 135633 15.92 MB/sec warmup 47 sec latency 41.441 ms 2024-02-19T22:00:42.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 88168 9.66 MB/sec warmup 51 sec latency 5.394 ms 2024-02-19T22:00:43.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 139168 15.99 MB/sec warmup 48 sec latency 49.021 ms 2024-02-19T22:00:43.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 89670 9.61 MB/sec warmup 52 sec latency 8.664 ms 2024-02-19T22:00:44.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:42.401138+0000 mgr.smithi099.zfglya (mgr.14180) 327 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 54 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.2 MiB/s wr, 205 op/s 2024-02-19T22:00:44.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:42.401138+0000 mgr.smithi099.zfglya (mgr.14180) 327 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 54 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.2 MiB/s wr, 205 op/s 2024-02-19T22:00:44.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 142650 16.05 MB/sec warmup 49 sec latency 32.049 ms 2024-02-19T22:00:44.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 91595 9.63 MB/sec warmup 53 sec latency 14.178 ms 2024-02-19T22:00:45.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 146145 16.11 MB/sec warmup 50 sec latency 56.867 ms 2024-02-19T22:00:45.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 93096 9.61 MB/sec warmup 54 sec latency 10.191 ms 2024-02-19T22:00:46.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:44.401535+0000 mgr.smithi099.zfglya (mgr.14180) 328 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 56 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.1 MiB/s wr, 192 op/s 2024-02-19T22:00:46.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:44.401535+0000 mgr.smithi099.zfglya (mgr.14180) 328 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 56 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.1 MiB/s wr, 192 op/s 2024-02-19T22:00:46.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 149677 16.16 MB/sec warmup 51 sec latency 50.506 ms 2024-02-19T22:00:46.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 94870 9.57 MB/sec warmup 55 sec latency 8.011 ms 2024-02-19T22:00:47.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 152297 16.13 MB/sec warmup 52 sec latency 27.029 ms 2024-02-19T22:00:47.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 96570 9.60 MB/sec warmup 56 sec latency 9.747 ms 2024-02-19T22:00:48.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:46.402019+0000 mgr.smithi099.zfglya (mgr.14180) 329 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 56 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.1 MiB/s wr, 189 op/s 2024-02-19T22:00:48.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:46.402019+0000 mgr.smithi099.zfglya (mgr.14180) 329 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 56 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.1 MiB/s wr, 189 op/s 2024-02-19T22:00:48.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 153543 15.93 MB/sec warmup 53 sec latency 261.992 ms 2024-02-19T22:00:48.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 98312 9.56 MB/sec warmup 57 sec latency 7.071 ms 2024-02-19T22:00:49.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 156976 15.98 MB/sec warmup 54 sec latency 297.029 ms 2024-02-19T22:00:49.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 100019 9.60 MB/sec warmup 58 sec latency 5.922 ms 2024-02-19T22:00:50.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:48.402571+0000 mgr.smithi099.zfglya (mgr.14180) 330 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 57 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.3 KiB/s rd, 4.0 MiB/s wr, 181 op/s 2024-02-19T22:00:50.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:48.402571+0000 mgr.smithi099.zfglya (mgr.14180) 330 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 57 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.3 KiB/s rd, 4.0 MiB/s wr, 181 op/s 2024-02-19T22:00:50.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 160445 16.04 MB/sec warmup 55 sec latency 33.380 ms 2024-02-19T22:00:50.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 101786 9.55 MB/sec warmup 59 sec latency 5.812 ms 2024-02-19T22:00:51.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 163923 16.09 MB/sec warmup 56 sec latency 49.676 ms 2024-02-19T22:00:51.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 103481 9.59 MB/sec warmup 60 sec latency 8.103 ms 2024-02-19T22:00:52.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:50.403029+0000 mgr.smithi099.zfglya (mgr.14180) 331 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 60 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.6 MiB/s wr, 229 op/s 2024-02-19T22:00:52.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:50.403029+0000 mgr.smithi099.zfglya (mgr.14180) 331 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 60 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.6 MiB/s wr, 229 op/s 2024-02-19T22:00:52.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 167465 16.14 MB/sec warmup 57 sec latency 27.800 ms 2024-02-19T22:00:52.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 105281 9.55 MB/sec warmup 61 sec latency 7.439 ms 2024-02-19T22:00:53.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 170954 16.19 MB/sec warmup 58 sec latency 33.478 ms 2024-02-19T22:00:53.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 106942 9.59 MB/sec warmup 62 sec latency 4.817 ms 2024-02-19T22:00:54.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:52.403487+0000 mgr.smithi099.zfglya (mgr.14180) 332 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 58 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.0 MiB/s wr, 191 op/s 2024-02-19T22:00:54.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:52.403487+0000 mgr.smithi099.zfglya (mgr.14180) 332 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 58 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.0 MiB/s wr, 191 op/s 2024-02-19T22:00:54.607 INFO:tasks.workunit.client.0.smithi099.stdout: 1 173601 16.16 MB/sec warmup 59 sec latency 58.424 ms 2024-02-19T22:00:54.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 108745 9.55 MB/sec warmup 63 sec latency 5.732 ms 2024-02-19T22:00:55.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 176741 16.18 MB/sec warmup 60 sec latency 66.594 ms 2024-02-19T22:00:55.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 110423 9.59 MB/sec warmup 64 sec latency 6.057 ms 2024-02-19T22:00:56.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:54.403926+0000 mgr.smithi099.zfglya (mgr.14180) 333 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 60 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 210 op/s 2024-02-19T22:00:56.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:54.403926+0000 mgr.smithi099.zfglya (mgr.14180) 333 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 60 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 210 op/s 2024-02-19T22:00:56.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 179743 16.13 MB/sec warmup 61 sec latency 27.821 ms 2024-02-19T22:00:56.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 112096 9.53 MB/sec warmup 65 sec latency 5.041 ms 2024-02-19T22:00:57.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 182802 16.16 MB/sec warmup 62 sec latency 48.664 ms 2024-02-19T22:00:57.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 113868 9.59 MB/sec warmup 66 sec latency 9.650 ms 2024-02-19T22:00:58.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:00:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:56.404390+0000 mgr.smithi099.zfglya (mgr.14180) 334 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 61 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 179 op/s 2024-02-19T22:00:58.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:00:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:56.404390+0000 mgr.smithi099.zfglya (mgr.14180) 334 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 61 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 179 op/s 2024-02-19T22:00:58.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 185379 16.13 MB/sec warmup 63 sec latency 61.426 ms 2024-02-19T22:00:58.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 115455 9.53 MB/sec warmup 67 sec latency 11.704 ms 2024-02-19T22:00:59.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 188813 16.17 MB/sec warmup 64 sec latency 53.259 ms 2024-02-19T22:00:59.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 117339 9.58 MB/sec warmup 68 sec latency 10.266 ms 2024-02-19T22:01:00.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:00:58.404790+0000 mgr.smithi099.zfglya (mgr.14180) 335 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 64 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.5 KiB/s rd, 3.9 MiB/s wr, 206 op/s 2024-02-19T22:01:00.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:00:58.404790+0000 mgr.smithi099.zfglya (mgr.14180) 335 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 64 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.5 KiB/s rd, 3.9 MiB/s wr, 206 op/s 2024-02-19T22:01:00.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 192288 16.21 MB/sec warmup 65 sec latency 49.784 ms 2024-02-19T22:01:00.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 118916 9.53 MB/sec warmup 69 sec latency 6.032 ms 2024-02-19T22:01:01.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 195782 16.26 MB/sec warmup 66 sec latency 41.726 ms 2024-02-19T22:01:01.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 120767 9.57 MB/sec warmup 70 sec latency 10.203 ms 2024-02-19T22:01:02.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:00.405277+0000 mgr.smithi099.zfglya (mgr.14180) 336 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 65 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.5 MiB/s wr, 222 op/s 2024-02-19T22:01:02.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:00.405277+0000 mgr.smithi099.zfglya (mgr.14180) 336 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 65 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.5 MiB/s wr, 222 op/s 2024-02-19T22:01:02.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 198430 16.23 MB/sec warmup 67 sec latency 53.982 ms 2024-02-19T22:01:02.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 122238 9.53 MB/sec warmup 71 sec latency 8.610 ms 2024-02-19T22:01:03.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:01:02.282880+0000 mon.smithi099 (mon.0) 737 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:01:03.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:01:02.615724+0000 mon.smithi099 (mon.0) 738 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:01:03.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:01:02.616451+0000 mon.smithi099 (mon.0) 739 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:01:03.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:01:02.620623+0000 mon.smithi099 (mon.0) 740 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:01:03.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:01:02.282880+0000 mon.smithi099 (mon.0) 737 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:01:03.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:01:02.615724+0000 mon.smithi099 (mon.0) 738 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:01:03.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:01:02.616451+0000 mon.smithi099 (mon.0) 739 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:01:03.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:01:02.620623+0000 mon.smithi099 (mon.0) 740 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:01:03.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 201833 16.25 MB/sec warmup 68 sec latency 33.646 ms 2024-02-19T22:01:03.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 124145 9.56 MB/sec warmup 72 sec latency 4.801 ms 2024-02-19T22:01:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:02.405762+0000 mgr.smithi099.zfglya (mgr.14180) 337 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 67 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.2 MiB/s wr, 195 op/s 2024-02-19T22:01:04.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:02.405762+0000 mgr.smithi099.zfglya (mgr.14180) 337 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 67 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.2 MiB/s wr, 195 op/s 2024-02-19T22:01:04.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 204954 16.26 MB/sec warmup 69 sec latency 32.749 ms 2024-02-19T22:01:04.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 125682 9.53 MB/sec warmup 73 sec latency 6.132 ms 2024-02-19T22:01:05.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 208075 16.24 MB/sec warmup 70 sec latency 41.280 ms 2024-02-19T22:01:05.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 127515 9.52 MB/sec warmup 74 sec latency 10.153 ms 2024-02-19T22:01:06.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:04.406150+0000 mgr.smithi099.zfglya (mgr.14180) 338 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 70 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.4 MiB/s wr, 222 op/s 2024-02-19T22:01:06.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:04.406150+0000 mgr.smithi099.zfglya (mgr.14180) 338 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 70 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.4 MiB/s wr, 222 op/s 2024-02-19T22:01:06.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 210918 16.26 MB/sec warmup 71 sec latency 32.797 ms 2024-02-19T22:01:06.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 129119 9.53 MB/sec warmup 75 sec latency 11.753 ms 2024-02-19T22:01:07.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 213745 16.24 MB/sec warmup 72 sec latency 50.060 ms 2024-02-19T22:01:07.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 131038 9.52 MB/sec warmup 76 sec latency 7.200 ms 2024-02-19T22:01:08.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:06.406554+0000 mgr.smithi099.zfglya (mgr.14180) 339 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 69 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 203 op/s 2024-02-19T22:01:08.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:06.406554+0000 mgr.smithi099.zfglya (mgr.14180) 339 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 69 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 203 op/s 2024-02-19T22:01:08.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 217232 16.27 MB/sec warmup 73 sec latency 52.151 ms 2024-02-19T22:01:08.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 132488 9.49 MB/sec warmup 77 sec latency 5.635 ms 2024-02-19T22:01:09.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 218060 16.12 MB/sec warmup 74 sec latency 441.893 ms 2024-02-19T22:01:09.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 134541 9.52 MB/sec warmup 78 sec latency 14.828 ms 2024-02-19T22:01:10.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:08.406946+0000 mgr.smithi099.zfglya (mgr.14180) 340 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 69 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 3.7 MiB/s wr, 194 op/s 2024-02-19T22:01:10.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:08.406946+0000 mgr.smithi099.zfglya (mgr.14180) 340 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 69 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 3.7 MiB/s wr, 194 op/s 2024-02-19T22:01:10.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 219758 16.03 MB/sec warmup 75 sec latency 407.526 ms 2024-02-19T22:01:10.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 135877 9.49 MB/sec warmup 79 sec latency 7.077 ms 2024-02-19T22:01:11.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 223159 16.05 MB/sec warmup 76 sec latency 33.221 ms 2024-02-19T22:01:11.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 137785 9.50 MB/sec warmup 80 sec latency 7.268 ms 2024-02-19T22:01:12.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:10.407412+0000 mgr.smithi099.zfglya (mgr.14180) 341 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 72 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.4 MiB/s wr, 202 op/s 2024-02-19T22:01:12.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:10.407412+0000 mgr.smithi099.zfglya (mgr.14180) 341 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 72 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.4 MiB/s wr, 202 op/s 2024-02-19T22:01:12.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 226433 16.08 MB/sec warmup 77 sec latency 27.534 ms 2024-02-19T22:01:12.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 139251 9.48 MB/sec warmup 81 sec latency 8.900 ms 2024-02-19T22:01:13.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 229402 16.05 MB/sec warmup 78 sec latency 43.888 ms 2024-02-19T22:01:13.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 140989 9.45 MB/sec warmup 82 sec latency 15.581 ms 2024-02-19T22:01:14.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:12.407833+0000 mgr.smithi099.zfglya (mgr.14180) 342 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 72 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.2 MiB/s wr, 196 op/s 2024-02-19T22:01:14.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:12.407833+0000 mgr.smithi099.zfglya (mgr.14180) 342 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 72 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.2 MiB/s wr, 196 op/s 2024-02-19T22:01:14.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 232499 16.07 MB/sec warmup 79 sec latency 33.628 ms 2024-02-19T22:01:14.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 142657 9.47 MB/sec warmup 83 sec latency 10.210 ms 2024-02-19T22:01:15.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 236041 16.11 MB/sec warmup 80 sec latency 50.181 ms 2024-02-19T22:01:15.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 144397 9.45 MB/sec warmup 84 sec latency 9.079 ms 2024-02-19T22:01:16.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:14.408221+0000 mgr.smithi099.zfglya (mgr.14180) 343 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 74 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 201 op/s 2024-02-19T22:01:16.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:14.408221+0000 mgr.smithi099.zfglya (mgr.14180) 343 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 74 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 201 op/s 2024-02-19T22:01:16.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 240042 16.16 MB/sec warmup 81 sec latency 32.309 ms 2024-02-19T22:01:16.770 INFO:tasks.workunit.client.1.smithi138.stdout: 1 146054 9.47 MB/sec warmup 85 sec latency 4.580 ms 2024-02-19T22:01:17.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 243130 16.18 MB/sec warmup 82 sec latency 33.378 ms 2024-02-19T22:01:17.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 147824 9.44 MB/sec warmup 86 sec latency 6.330 ms 2024-02-19T22:01:18.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:16.408763+0000 mgr.smithi099.zfglya (mgr.14180) 344 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 75 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.1 MiB/s wr, 172 op/s 2024-02-19T22:01:18.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:16.408763+0000 mgr.smithi099.zfglya (mgr.14180) 344 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 75 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.1 MiB/s wr, 172 op/s 2024-02-19T22:01:18.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 245776 16.16 MB/sec warmup 83 sec latency 49.969 ms 2024-02-19T22:01:18.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 149463 9.47 MB/sec warmup 87 sec latency 6.636 ms 2024-02-19T22:01:19.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 249213 16.19 MB/sec warmup 84 sec latency 27.577 ms 2024-02-19T22:01:19.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 151184 9.43 MB/sec warmup 88 sec latency 12.777 ms 2024-02-19T22:01:20.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:18.409228+0000 mgr.smithi099.zfglya (mgr.14180) 345 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 77 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.9 MiB/s wr, 201 op/s 2024-02-19T22:01:20.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:18.409228+0000 mgr.smithi099.zfglya (mgr.14180) 345 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 77 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.9 MiB/s wr, 201 op/s 2024-02-19T22:01:20.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 252680 16.23 MB/sec warmup 85 sec latency 78.687 ms 2024-02-19T22:01:20.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 152935 9.47 MB/sec warmup 89 sec latency 10.398 ms 2024-02-19T22:01:21.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 256106 16.26 MB/sec warmup 86 sec latency 168.736 ms 2024-02-19T22:01:21.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 154604 9.43 MB/sec warmup 90 sec latency 16.474 ms 2024-02-19T22:01:22.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:20.409700+0000 mgr.smithi099.zfglya (mgr.14180) 346 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 76 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.3 MiB/s wr, 212 op/s 2024-02-19T22:01:22.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:20.409700+0000 mgr.smithi099.zfglya (mgr.14180) 346 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 76 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.3 MiB/s wr, 212 op/s 2024-02-19T22:01:22.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 259646 16.29 MB/sec warmup 87 sec latency 33.686 ms 2024-02-19T22:01:22.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 156410 9.47 MB/sec warmup 91 sec latency 7.024 ms 2024-02-19T22:01:23.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 262263 16.27 MB/sec warmup 88 sec latency 49.597 ms 2024-02-19T22:01:23.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 157988 9.43 MB/sec warmup 92 sec latency 8.154 ms 2024-02-19T22:01:24.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:22.410200+0000 mgr.smithi099.zfglya (mgr.14180) 347 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 79 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.4 KiB/s rd, 4.2 MiB/s wr, 213 op/s 2024-02-19T22:01:24.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:22.410200+0000 mgr.smithi099.zfglya (mgr.14180) 347 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 79 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.4 KiB/s rd, 4.2 MiB/s wr, 213 op/s 2024-02-19T22:01:24.608 INFO:tasks.workunit.client.0.smithi099.stdout: 1 265509 16.28 MB/sec warmup 89 sec latency 28.026 ms 2024-02-19T22:01:24.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 159886 9.48 MB/sec warmup 93 sec latency 9.506 ms 2024-02-19T22:01:25.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 268478 16.25 MB/sec warmup 90 sec latency 33.965 ms 2024-02-19T22:01:25.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 161444 9.44 MB/sec warmup 94 sec latency 5.480 ms 2024-02-19T22:01:26.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:24.410630+0000 mgr.smithi099.zfglya (mgr.14180) 348 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 79 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 205 op/s 2024-02-19T22:01:26.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:24.410630+0000 mgr.smithi099.zfglya (mgr.14180) 348 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 79 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 205 op/s 2024-02-19T22:01:26.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 271493 16.26 MB/sec warmup 91 sec latency 50.052 ms 2024-02-19T22:01:26.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 163295 9.47 MB/sec warmup 95 sec latency 8.151 ms 2024-02-19T22:01:27.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 274789 16.29 MB/sec warmup 92 sec latency 41.665 ms 2024-02-19T22:01:27.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 164799 9.44 MB/sec warmup 96 sec latency 7.912 ms 2024-02-19T22:01:28.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:26.411114+0000 mgr.smithi099.zfglya (mgr.14180) 349 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 80 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 185 op/s 2024-02-19T22:01:28.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:26.411114+0000 mgr.smithi099.zfglya (mgr.14180) 349 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 80 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 185 op/s 2024-02-19T22:01:28.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 277686 16.27 MB/sec warmup 93 sec latency 33.179 ms 2024-02-19T22:01:28.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 166574 9.43 MB/sec warmup 97 sec latency 11.138 ms 2024-02-19T22:01:29.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 281235 16.30 MB/sec warmup 94 sec latency 49.919 ms 2024-02-19T22:01:29.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 168190 9.44 MB/sec warmup 98 sec latency 5.867 ms 2024-02-19T22:01:30.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:28.411557+0000 mgr.smithi099.zfglya (mgr.14180) 350 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 82 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.8 MiB/s wr, 202 op/s 2024-02-19T22:01:30.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:28.411557+0000 mgr.smithi099.zfglya (mgr.14180) 350 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 82 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.8 MiB/s wr, 202 op/s 2024-02-19T22:01:30.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 285272 16.38 MB/sec warmup 95 sec latency 27.934 ms 2024-02-19T22:01:30.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 170048 9.44 MB/sec warmup 99 sec latency 9.100 ms 2024-02-19T22:01:31.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 288216 16.36 MB/sec warmup 96 sec latency 66.475 ms 2024-02-19T22:01:31.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 171475 9.41 MB/sec warmup 100 sec latency 9.853 ms 2024-02-19T22:01:32.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:30.412021+0000 mgr.smithi099.zfglya (mgr.14180) 351 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 83 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 210 op/s 2024-02-19T22:01:32.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:30.412021+0000 mgr.smithi099.zfglya (mgr.14180) 351 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 83 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 210 op/s 2024-02-19T22:01:32.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 291681 16.39 MB/sec warmup 97 sec latency 48.627 ms 2024-02-19T22:01:32.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 173540 9.44 MB/sec warmup 101 sec latency 8.814 ms 2024-02-19T22:01:33.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 295165 16.41 MB/sec warmup 98 sec latency 33.571 ms 2024-02-19T22:01:33.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 174931 9.41 MB/sec warmup 102 sec latency 5.500 ms 2024-02-19T22:01:34.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:32.412487+0000 mgr.smithi099.zfglya (mgr.14180) 352 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 85 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.4 MiB/s wr, 213 op/s 2024-02-19T22:01:34.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:32.412487+0000 mgr.smithi099.zfglya (mgr.14180) 352 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 85 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.4 MiB/s wr, 213 op/s 2024-02-19T22:01:34.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 298706 16.44 MB/sec warmup 99 sec latency 41.107 ms 2024-02-19T22:01:34.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 176844 9.42 MB/sec warmup 103 sec latency 9.873 ms 2024-02-19T22:01:35.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 302208 16.47 MB/sec warmup 100 sec latency 33.662 ms 2024-02-19T22:01:35.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 178402 9.41 MB/sec warmup 104 sec latency 5.505 ms 2024-02-19T22:01:36.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:34.412903+0000 mgr.smithi099.zfglya (mgr.14180) 353 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 85 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.9 KiB/s rd, 3.9 MiB/s wr, 163 op/s 2024-02-19T22:01:36.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:34.412903+0000 mgr.smithi099.zfglya (mgr.14180) 353 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 85 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.9 KiB/s rd, 3.9 MiB/s wr, 163 op/s 2024-02-19T22:01:36.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 305742 16.49 MB/sec warmup 101 sec latency 61.249 ms 2024-02-19T22:01:36.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 180296 9.43 MB/sec warmup 105 sec latency 13.961 ms 2024-02-19T22:01:37.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 308259 16.46 MB/sec warmup 102 sec latency 50.097 ms 2024-02-19T22:01:37.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 181826 9.41 MB/sec warmup 106 sec latency 9.463 ms 2024-02-19T22:01:38.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:36.413387+0000 mgr.smithi099.zfglya (mgr.14180) 354 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 86 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.0 MiB/s wr, 185 op/s 2024-02-19T22:01:38.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:36.413387+0000 mgr.smithi099.zfglya (mgr.14180) 354 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 86 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.0 MiB/s wr, 185 op/s 2024-02-19T22:01:38.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 311915 16.50 MB/sec warmup 103 sec latency 33.501 ms 2024-02-19T22:01:38.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 183631 9.41 MB/sec warmup 107 sec latency 11.634 ms 2024-02-19T22:01:39.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 315450 16.52 MB/sec warmup 104 sec latency 33.612 ms 2024-02-19T22:01:39.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 185236 9.41 MB/sec warmup 108 sec latency 9.697 ms 2024-02-19T22:01:40.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:38.413816+0000 mgr.smithi099.zfglya (mgr.14180) 355 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 89 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.1 MiB/s wr, 217 op/s 2024-02-19T22:01:40.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:38.413816+0000 mgr.smithi099.zfglya (mgr.14180) 355 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 89 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.1 MiB/s wr, 217 op/s 2024-02-19T22:01:40.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 318997 16.55 MB/sec warmup 105 sec latency 49.918 ms 2024-02-19T22:01:40.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 186951 9.39 MB/sec warmup 109 sec latency 11.942 ms 2024-02-19T22:01:41.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 320052 16.44 MB/sec warmup 106 sec latency 271.205 ms 2024-02-19T22:01:41.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 188607 9.40 MB/sec warmup 110 sec latency 4.574 ms 2024-02-19T22:01:42.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:40.414303+0000 mgr.smithi099.zfglya (mgr.14180) 356 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 89 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 199 op/s 2024-02-19T22:01:42.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:40.414303+0000 mgr.smithi099.zfglya (mgr.14180) 356 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 89 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 199 op/s 2024-02-19T22:01:42.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 322573 16.41 MB/sec warmup 107 sec latency 375.102 ms 2024-02-19T22:01:42.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 190362 9.38 MB/sec warmup 111 sec latency 20.678 ms 2024-02-19T22:01:43.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 325989 16.43 MB/sec warmup 108 sec latency 25.115 ms 2024-02-19T22:01:43.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 192008 9.41 MB/sec warmup 112 sec latency 7.107 ms 2024-02-19T22:01:44.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:42.414805+0000 mgr.smithi099.zfglya (mgr.14180) 357 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 89 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.1 MiB/s wr, 180 op/s 2024-02-19T22:01:44.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:42.414805+0000 mgr.smithi099.zfglya (mgr.14180) 357 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 89 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.1 MiB/s wr, 180 op/s 2024-02-19T22:01:44.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 329257 16.45 MB/sec warmup 109 sec latency 41.773 ms 2024-02-19T22:01:44.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 193696 9.37 MB/sec warmup 113 sec latency 12.855 ms 2024-02-19T22:01:45.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 332652 16.46 MB/sec warmup 110 sec latency 44.463 ms 2024-02-19T22:01:45.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 195437 9.41 MB/sec warmup 114 sec latency 10.276 ms 2024-02-19T22:01:46.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:44.415207+0000 mgr.smithi099.zfglya (mgr.14180) 358 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 92 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 208 op/s 2024-02-19T22:01:46.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:44.415207+0000 mgr.smithi099.zfglya (mgr.14180) 358 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 92 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 208 op/s 2024-02-19T22:01:46.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 336347 16.50 MB/sec warmup 111 sec latency 32.473 ms 2024-02-19T22:01:46.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 197022 9.38 MB/sec warmup 115 sec latency 9.240 ms 2024-02-19T22:01:47.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 339395 16.47 MB/sec warmup 112 sec latency 36.199 ms 2024-02-19T22:01:47.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 198893 9.41 MB/sec warmup 116 sec latency 10.889 ms 2024-02-19T22:01:48.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:46.415650+0000 mgr.smithi099.zfglya (mgr.14180) 359 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 93 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.3 MiB/s wr, 222 op/s 2024-02-19T22:01:48.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:46.415650+0000 mgr.smithi099.zfglya (mgr.14180) 359 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 93 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.3 MiB/s wr, 222 op/s 2024-02-19T22:01:48.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 342412 16.48 MB/sec warmup 113 sec latency 50.024 ms 2024-02-19T22:01:48.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 200436 9.38 MB/sec warmup 117 sec latency 12.668 ms 2024-02-19T22:01:49.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 345705 16.50 MB/sec warmup 114 sec latency 27.722 ms 2024-02-19T22:01:49.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 202291 9.40 MB/sec warmup 118 sec latency 6.071 ms 2024-02-19T22:01:50.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:48.416062+0000 mgr.smithi099.zfglya (mgr.14180) 360 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 93 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.4 KiB/s rd, 3.9 MiB/s wr, 207 op/s 2024-02-19T22:01:50.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:48.416062+0000 mgr.smithi099.zfglya (mgr.14180) 360 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 93 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.4 KiB/s rd, 3.9 MiB/s wr, 207 op/s 2024-02-19T22:01:50.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 348537 16.48 MB/sec warmup 115 sec latency 44.886 ms 2024-02-19T22:01:50.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 203770 9.38 MB/sec warmup 119 sec latency 7.828 ms 2024-02-19T22:01:51.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 352041 16.51 MB/sec warmup 116 sec latency 27.666 ms 2024-02-19T22:01:52.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:50.416519+0000 mgr.smithi099.zfglya (mgr.14180) 361 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 93 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 186 op/s 2024-02-19T22:01:52.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:50.416519+0000 mgr.smithi099.zfglya (mgr.14180) 361 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 93 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 186 op/s 2024-02-19T22:01:52.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 355440 16.53 MB/sec warmup 117 sec latency 110.087 ms 2024-02-19T22:01:52.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 207133 9.68 MB/sec execute 1 sec latency 10.323 ms 2024-02-19T22:01:53.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 358935 16.55 MB/sec warmup 118 sec latency 47.491 ms 2024-02-19T22:01:53.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 209037 9.51 MB/sec execute 2 sec latency 6.662 ms 2024-02-19T22:01:54.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:52.416957+0000 mgr.smithi099.zfglya (mgr.14180) 362 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 100 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.5 MiB/s wr, 228 op/s 2024-02-19T22:01:54.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:52.416957+0000 mgr.smithi099.zfglya (mgr.14180) 362 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 100 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.5 MiB/s wr, 228 op/s 2024-02-19T22:01:54.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 362470 16.57 MB/sec warmup 119 sec latency 33.620 ms 2024-02-19T22:01:54.771 INFO:tasks.workunit.client.1.smithi138.stdout: 1 210499 8.61 MB/sec execute 3 sec latency 11.780 ms 2024-02-19T22:01:55.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 212555 9.53 MB/sec execute 4 sec latency 11.678 ms 2024-02-19T22:01:56.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:54.417358+0000 mgr.smithi099.zfglya (mgr.14180) 363 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 100 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 197 op/s 2024-02-19T22:01:56.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:54.417358+0000 mgr.smithi099.zfglya (mgr.14180) 363 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 100 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 197 op/s 2024-02-19T22:01:56.609 INFO:tasks.workunit.client.0.smithi099.stdout: 1 367818 13.55 MB/sec execute 1 sec latency 75.066 ms 2024-02-19T22:01:56.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 213940 8.97 MB/sec execute 5 sec latency 10.293 ms 2024-02-19T22:01:57.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 370778 15.17 MB/sec execute 2 sec latency 27.697 ms 2024-02-19T22:01:57.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 215872 9.25 MB/sec execute 6 sec latency 11.588 ms 2024-02-19T22:01:58.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:01:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:56.417829+0000 mgr.smithi099.zfglya (mgr.14180) 364 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 99 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.9 MiB/s wr, 167 op/s 2024-02-19T22:01:58.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:01:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:56.417829+0000 mgr.smithi099.zfglya (mgr.14180) 364 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 99 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.9 MiB/s wr, 167 op/s 2024-02-19T22:01:58.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 374809 17.01 MB/sec execute 3 sec latency 48.828 ms 2024-02-19T22:01:58.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 217364 8.98 MB/sec execute 7 sec latency 5.258 ms 2024-02-19T22:01:59.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 377905 17.16 MB/sec execute 4 sec latency 27.201 ms 2024-02-19T22:01:59.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 219191 9.13 MB/sec execute 8 sec latency 14.850 ms 2024-02-19T22:02:00.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:01:58.418399+0000 mgr.smithi099.zfglya (mgr.14180) 365 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 101 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.8 MiB/s wr, 196 op/s 2024-02-19T22:02:00.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:01:58.418399+0000 mgr.smithi099.zfglya (mgr.14180) 365 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 101 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.8 MiB/s wr, 196 op/s 2024-02-19T22:02:00.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 381456 17.55 MB/sec execute 5 sec latency 28.003 ms 2024-02-19T22:02:00.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 220790 9.08 MB/sec execute 9 sec latency 9.414 ms 2024-02-19T22:02:01.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 384592 17.76 MB/sec execute 6 sec latency 45.118 ms 2024-02-19T22:02:01.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 222561 8.92 MB/sec execute 10 sec latency 9.411 ms 2024-02-19T22:02:02.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:00.418854+0000 mgr.smithi099.zfglya (mgr.14180) 366 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 101 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 199 op/s 2024-02-19T22:02:02.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:00.418854+0000 mgr.smithi099.zfglya (mgr.14180) 366 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 101 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 199 op/s 2024-02-19T22:02:02.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 387489 17.31 MB/sec execute 7 sec latency 83.424 ms 2024-02-19T22:02:02.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 224224 9.14 MB/sec execute 11 sec latency 10.328 ms 2024-02-19T22:02:03.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:02:02.625773+0000 mon.smithi099 (mon.0) 741 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:02:03.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:02:02.884841+0000 mon.smithi099 (mon.0) 742 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:02:03.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:02:02.625773+0000 mon.smithi099 (mon.0) 741 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:02:03.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:02:02.884841+0000 mon.smithi099 (mon.0) 742 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:02:03.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 391025 17.53 MB/sec execute 8 sec latency 27.545 ms 2024-02-19T22:02:03.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 225946 8.95 MB/sec execute 12 sec latency 9.327 ms 2024-02-19T22:02:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:02.419322+0000 mgr.smithi099.zfglya (mgr.14180) 367 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 104 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.5 MiB/s wr, 218 op/s 2024-02-19T22:02:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:02:03.208085+0000 mon.smithi099 (mon.0) 743 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:02:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:02:03.208775+0000 mon.smithi099 (mon.0) 744 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:02:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:02:03.212970+0000 mon.smithi099 (mon.0) 745 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:02:04.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:02.419322+0000 mgr.smithi099.zfglya (mgr.14180) 367 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 104 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.5 MiB/s wr, 218 op/s 2024-02-19T22:02:04.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:02:03.208085+0000 mon.smithi099 (mon.0) 743 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:02:04.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:02:03.208775+0000 mon.smithi099 (mon.0) 744 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:02:04.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:02:03.212970+0000 mon.smithi099 (mon.0) 745 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:02:04.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 394504 17.69 MB/sec execute 9 sec latency 47.289 ms 2024-02-19T22:02:04.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 227608 9.19 MB/sec execute 13 sec latency 8.643 ms 2024-02-19T22:02:05.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 397998 17.82 MB/sec execute 10 sec latency 27.510 ms 2024-02-19T22:02:05.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 229408 9.02 MB/sec execute 14 sec latency 13.571 ms 2024-02-19T22:02:06.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:04.419786+0000 mgr.smithi099.zfglya (mgr.14180) 368 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 104 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.9 MiB/s wr, 168 op/s 2024-02-19T22:02:06.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:04.419786+0000 mgr.smithi099.zfglya (mgr.14180) 368 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 104 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.9 MiB/s wr, 168 op/s 2024-02-19T22:02:06.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 401535 17.94 MB/sec execute 11 sec latency 49.990 ms 2024-02-19T22:02:06.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 231071 9.23 MB/sec execute 15 sec latency 3.892 ms 2024-02-19T22:02:07.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 404152 17.62 MB/sec execute 12 sec latency 33.732 ms 2024-02-19T22:02:07.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 232786 9.02 MB/sec execute 16 sec latency 16.620 ms 2024-02-19T22:02:08.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:06.420257+0000 mgr.smithi099.zfglya (mgr.14180) 369 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 106 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-02-19T22:02:08.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:06.420257+0000 mgr.smithi099.zfglya (mgr.14180) 369 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 106 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-02-19T22:02:08.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 407320 17.59 MB/sec execute 13 sec latency 33.568 ms 2024-02-19T22:02:08.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 234530 9.27 MB/sec execute 17 sec latency 4.941 ms 2024-02-19T22:02:09.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 410326 17.31 MB/sec execute 14 sec latency 50.082 ms 2024-02-19T22:02:09.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 236165 9.07 MB/sec execute 18 sec latency 9.898 ms 2024-02-19T22:02:10.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:08.420672+0000 mgr.smithi099.zfglya (mgr.14180) 370 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 103 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.8 MiB/s wr, 208 op/s 2024-02-19T22:02:10.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:08.420672+0000 mgr.smithi099.zfglya (mgr.14180) 370 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 103 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.8 MiB/s wr, 208 op/s 2024-02-19T22:02:10.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 413382 17.32 MB/sec execute 15 sec latency 32.252 ms 2024-02-19T22:02:10.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 237965 9.29 MB/sec execute 19 sec latency 10.586 ms 2024-02-19T22:02:11.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 416033 17.16 MB/sec execute 16 sec latency 41.810 ms 2024-02-19T22:02:11.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 239507 9.11 MB/sec execute 20 sec latency 11.170 ms 2024-02-19T22:02:12.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:10.421183+0000 mgr.smithi099.zfglya (mgr.14180) 371 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 104 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 198 op/s 2024-02-19T22:02:12.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:10.421183+0000 mgr.smithi099.zfglya (mgr.14180) 371 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 104 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 198 op/s 2024-02-19T22:02:12.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 419467 17.26 MB/sec execute 17 sec latency 49.974 ms 2024-02-19T22:02:12.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 241368 9.26 MB/sec execute 21 sec latency 5.101 ms 2024-02-19T22:02:13.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 420473 16.56 MB/sec execute 18 sec latency 298.285 ms 2024-02-19T22:02:13.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 242817 9.14 MB/sec execute 22 sec latency 50.450 ms 2024-02-19T22:02:14.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:12.421629+0000 mgr.smithi099.zfglya (mgr.14180) 372 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 106 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.5 KiB/s rd, 4.1 MiB/s wr, 199 op/s 2024-02-19T22:02:14.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:12.421629+0000 mgr.smithi099.zfglya (mgr.14180) 372 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 106 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.5 KiB/s rd, 4.1 MiB/s wr, 199 op/s 2024-02-19T22:02:14.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 422866 16.43 MB/sec execute 19 sec latency 351.943 ms 2024-02-19T22:02:14.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 244633 9.15 MB/sec execute 23 sec latency 4.345 ms 2024-02-19T22:02:15.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 426362 16.56 MB/sec execute 20 sec latency 50.091 ms 2024-02-19T22:02:15.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 246280 9.17 MB/sec execute 24 sec latency 4.796 ms 2024-02-19T22:02:16.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:14.422045+0000 mgr.smithi099.zfglya (mgr.14180) 373 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 110 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 197 op/s 2024-02-19T22:02:16.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:14.422045+0000 mgr.smithi099.zfglya (mgr.14180) 373 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 110 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 197 op/s 2024-02-19T22:02:16.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 429901 16.68 MB/sec execute 21 sec latency 33.474 ms 2024-02-19T22:02:16.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 248118 9.18 MB/sec execute 25 sec latency 6.325 ms 2024-02-19T22:02:17.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 432558 16.57 MB/sec execute 22 sec latency 41.640 ms 2024-02-19T22:02:17.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 249717 9.20 MB/sec execute 26 sec latency 8.023 ms 2024-02-19T22:02:18.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:16.422518+0000 mgr.smithi099.zfglya (mgr.14180) 374 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 112 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 227 op/s 2024-02-19T22:02:18.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:16.422518+0000 mgr.smithi099.zfglya (mgr.14180) 374 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 112 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 227 op/s 2024-02-19T22:02:18.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 436067 16.68 MB/sec execute 23 sec latency 27.142 ms 2024-02-19T22:02:18.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 251637 9.20 MB/sec execute 27 sec latency 11.087 ms 2024-02-19T22:02:19.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 439311 16.70 MB/sec execute 24 sec latency 28.828 ms 2024-02-19T22:02:19.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 253096 9.12 MB/sec execute 28 sec latency 6.141 ms 2024-02-19T22:02:20.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:18.422952+0000 mgr.smithi099.zfglya (mgr.14180) 375 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 114 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 3.9 MiB/s wr, 174 op/s 2024-02-19T22:02:20.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:18.422952+0000 mgr.smithi099.zfglya (mgr.14180) 375 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 114 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 3.9 MiB/s wr, 174 op/s 2024-02-19T22:02:20.610 INFO:tasks.workunit.client.0.smithi099.stdout: 1 442273 16.58 MB/sec execute 25 sec latency 50.344 ms 2024-02-19T22:02:20.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 255150 9.23 MB/sec execute 29 sec latency 5.486 ms 2024-02-19T22:02:21.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 445299 16.61 MB/sec execute 26 sec latency 28.093 ms 2024-02-19T22:02:21.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 256509 9.14 MB/sec execute 30 sec latency 8.716 ms 2024-02-19T22:02:22.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:20.423448+0000 mgr.smithi099.zfglya (mgr.14180) 376 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 113 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 187 op/s 2024-02-19T22:02:22.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:20.423448+0000 mgr.smithi099.zfglya (mgr.14180) 376 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 113 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 187 op/s 2024-02-19T22:02:22.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 448584 16.70 MB/sec execute 27 sec latency 27.732 ms 2024-02-19T22:02:22.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 258351 9.19 MB/sec execute 31 sec latency 22.741 ms 2024-02-19T22:02:23.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:22.423900+0000 mgr.smithi099.zfglya (mgr.14180) 377 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 114 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.3 MiB/s wr, 208 op/s 2024-02-19T22:02:23.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:22.423900+0000 mgr.smithi099.zfglya (mgr.14180) 377 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 114 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.3 MiB/s wr, 208 op/s 2024-02-19T22:02:23.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 451422 16.63 MB/sec execute 28 sec latency 57.007 ms 2024-02-19T22:02:23.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 259860 9.13 MB/sec execute 32 sec latency 12.306 ms 2024-02-19T22:02:24.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 454843 16.70 MB/sec execute 29 sec latency 83.569 ms 2024-02-19T22:02:24.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 261574 9.08 MB/sec execute 33 sec latency 15.428 ms 2024-02-19T22:02:25.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 459008 17.48 MB/sec execute 30 sec latency 166.763 ms 2024-02-19T22:02:25.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 263229 9.14 MB/sec execute 34 sec latency 9.508 ms 2024-02-19T22:02:25.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:24.424334+0000 mgr.smithi099.zfglya (mgr.14180) 378 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 114 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.2 MiB/s wr, 195 op/s 2024-02-19T22:02:25.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:24.424334+0000 mgr.smithi099.zfglya (mgr.14180) 378 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 114 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.2 MiB/s wr, 195 op/s 2024-02-19T22:02:26.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 461641 17.37 MB/sec execute 31 sec latency 26.547 ms 2024-02-19T22:02:26.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 264965 9.08 MB/sec execute 35 sec latency 8.616 ms 2024-02-19T22:02:27.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 464821 17.37 MB/sec execute 32 sec latency 33.577 ms 2024-02-19T22:02:27.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 266648 9.16 MB/sec execute 36 sec latency 10.638 ms 2024-02-19T22:02:27.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:26.424788+0000 mgr.smithi099.zfglya (mgr.14180) 379 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 118 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 212 op/s 2024-02-19T22:02:27.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:26.424788+0000 mgr.smithi099.zfglya (mgr.14180) 379 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 118 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 212 op/s 2024-02-19T22:02:28.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 467824 17.26 MB/sec execute 33 sec latency 49.519 ms 2024-02-19T22:02:28.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 268423 9.10 MB/sec execute 37 sec latency 19.178 ms 2024-02-19T22:02:29.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 470633 17.26 MB/sec execute 34 sec latency 41.728 ms 2024-02-19T22:02:29.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 270060 9.18 MB/sec execute 38 sec latency 6.340 ms 2024-02-19T22:02:29.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:28.425177+0000 mgr.smithi099.zfglya (mgr.14180) 380 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 119 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.8 MiB/s wr, 186 op/s 2024-02-19T22:02:29.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:28.425177+0000 mgr.smithi099.zfglya (mgr.14180) 380 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 119 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.8 MiB/s wr, 186 op/s 2024-02-19T22:02:30.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 473532 17.19 MB/sec execute 35 sec latency 26.946 ms 2024-02-19T22:02:30.772 INFO:tasks.workunit.client.1.smithi138.stdout: 1 271720 9.09 MB/sec execute 39 sec latency 9.529 ms 2024-02-19T22:02:31.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 476971 17.24 MB/sec execute 36 sec latency 67.133 ms 2024-02-19T22:02:31.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 273488 9.20 MB/sec execute 40 sec latency 7.496 ms 2024-02-19T22:02:31.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:30.425692+0000 mgr.smithi099.zfglya (mgr.14180) 381 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 202 op/s 2024-02-19T22:02:31.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:30.425692+0000 mgr.smithi099.zfglya (mgr.14180) 381 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 202 op/s 2024-02-19T22:02:32.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 480474 17.28 MB/sec execute 37 sec latency 33.352 ms 2024-02-19T22:02:32.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 275061 9.11 MB/sec execute 41 sec latency 16.815 ms 2024-02-19T22:02:33.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 483963 17.33 MB/sec execute 38 sec latency 49.654 ms 2024-02-19T22:02:33.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 276934 9.21 MB/sec execute 42 sec latency 10.484 ms 2024-02-19T22:02:33.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:32.426165+0000 mgr.smithi099.zfglya (mgr.14180) 382 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 121 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.5 MiB/s wr, 239 op/s 2024-02-19T22:02:33.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:32.426165+0000 mgr.smithi099.zfglya (mgr.14180) 382 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 121 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.5 MiB/s wr, 239 op/s 2024-02-19T22:02:34.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 487500 17.37 MB/sec execute 39 sec latency 27.706 ms 2024-02-19T22:02:34.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 278480 9.13 MB/sec execute 43 sec latency 6.802 ms 2024-02-19T22:02:35.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 491041 17.42 MB/sec execute 40 sec latency 41.753 ms 2024-02-19T22:02:35.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 280360 9.20 MB/sec execute 44 sec latency 10.496 ms 2024-02-19T22:02:35.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:34.426518+0000 mgr.smithi099.zfglya (mgr.14180) 383 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 122 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.1 MiB/s wr, 185 op/s 2024-02-19T22:02:35.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:34.426518+0000 mgr.smithi099.zfglya (mgr.14180) 383 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 122 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.1 MiB/s wr, 185 op/s 2024-02-19T22:02:36.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 494535 17.46 MB/sec execute 41 sec latency 41.763 ms 2024-02-19T22:02:36.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 281861 9.14 MB/sec execute 45 sec latency 9.491 ms 2024-02-19T22:02:37.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 498076 17.49 MB/sec execute 42 sec latency 33.312 ms 2024-02-19T22:02:37.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 283752 9.21 MB/sec execute 46 sec latency 14.172 ms 2024-02-19T22:02:37.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:36.426983+0000 mgr.smithi099.zfglya (mgr.14180) 384 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 120 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 195 op/s 2024-02-19T22:02:37.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:36.426983+0000 mgr.smithi099.zfglya (mgr.14180) 384 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 120 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 195 op/s 2024-02-19T22:02:38.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 500694 17.42 MB/sec execute 43 sec latency 41.622 ms 2024-02-19T22:02:38.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 285272 9.16 MB/sec execute 47 sec latency 9.679 ms 2024-02-19T22:02:39.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 503708 17.38 MB/sec execute 44 sec latency 57.065 ms 2024-02-19T22:02:39.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 287109 9.16 MB/sec execute 48 sec latency 9.048 ms 2024-02-19T22:02:39.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:38.427412+0000 mgr.smithi099.zfglya (mgr.14180) 385 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 125 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.3 KiB/s rd, 3.7 MiB/s wr, 183 op/s 2024-02-19T22:02:39.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:38.427412+0000 mgr.smithi099.zfglya (mgr.14180) 385 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 125 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.3 KiB/s rd, 3.7 MiB/s wr, 183 op/s 2024-02-19T22:02:40.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 506837 17.33 MB/sec execute 45 sec latency 30.704 ms 2024-02-19T22:02:40.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 288612 9.11 MB/sec execute 49 sec latency 9.813 ms 2024-02-19T22:02:41.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 509672 17.33 MB/sec execute 46 sec latency 50.235 ms 2024-02-19T22:02:41.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 290624 9.18 MB/sec execute 50 sec latency 14.270 ms 2024-02-19T22:02:42.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:40.427904+0000 mgr.smithi099.zfglya (mgr.14180) 386 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 125 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 190 op/s 2024-02-19T22:02:42.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:40.427904+0000 mgr.smithi099.zfglya (mgr.14180) 386 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 125 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 190 op/s 2024-02-19T22:02:42.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 512507 17.27 MB/sec execute 47 sec latency 27.465 ms 2024-02-19T22:02:42.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 292030 9.13 MB/sec execute 51 sec latency 5.893 ms 2024-02-19T22:02:43.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 516011 17.31 MB/sec execute 48 sec latency 27.597 ms 2024-02-19T22:02:43.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 293889 9.16 MB/sec execute 52 sec latency 13.036 ms 2024-02-19T22:02:44.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:42.428611+0000 mgr.smithi099.zfglya (mgr.14180) 387 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 127 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.2 MiB/s wr, 207 op/s 2024-02-19T22:02:44.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:42.428611+0000 mgr.smithi099.zfglya (mgr.14180) 387 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 127 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.2 MiB/s wr, 207 op/s 2024-02-19T22:02:44.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 519482 17.34 MB/sec execute 49 sec latency 56.735 ms 2024-02-19T22:02:44.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 295398 9.12 MB/sec execute 53 sec latency 10.208 ms 2024-02-19T22:02:45.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 521152 17.14 MB/sec execute 50 sec latency 458.308 ms 2024-02-19T22:02:45.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 297176 9.14 MB/sec execute 54 sec latency 19.313 ms 2024-02-19T22:02:46.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:44.429078+0000 mgr.smithi099.zfglya (mgr.14180) 388 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 129 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.1 MiB/s wr, 188 op/s 2024-02-19T22:02:46.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:44.429078+0000 mgr.smithi099.zfglya (mgr.14180) 388 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 129 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.1 MiB/s wr, 188 op/s 2024-02-19T22:02:46.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 522902 17.03 MB/sec execute 51 sec latency 391.322 ms 2024-02-19T22:02:46.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 298743 9.13 MB/sec execute 55 sec latency 9.661 ms 2024-02-19T22:02:47.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 525551 16.98 MB/sec execute 52 sec latency 55.364 ms 2024-02-19T22:02:47.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 300515 9.10 MB/sec execute 56 sec latency 5.718 ms 2024-02-19T22:02:48.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:46.429524+0000 mgr.smithi099.zfglya (mgr.14180) 389 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 129 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 201 op/s 2024-02-19T22:02:48.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:46.429524+0000 mgr.smithi099.zfglya (mgr.14180) 389 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 129 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 201 op/s 2024-02-19T22:02:48.611 INFO:tasks.workunit.client.0.smithi099.stdout: 1 529057 17.02 MB/sec execute 53 sec latency 27.825 ms 2024-02-19T22:02:48.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 302183 9.14 MB/sec execute 57 sec latency 6.247 ms 2024-02-19T22:02:49.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 532106 17.00 MB/sec execute 54 sec latency 49.613 ms 2024-02-19T22:02:49.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 303933 9.10 MB/sec execute 58 sec latency 15.771 ms 2024-02-19T22:02:50.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:48.429949+0000 mgr.smithi099.zfglya (mgr.14180) 390 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 128 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.9 MiB/s wr, 189 op/s 2024-02-19T22:02:50.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:48.429949+0000 mgr.smithi099.zfglya (mgr.14180) 390 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 128 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.9 MiB/s wr, 189 op/s 2024-02-19T22:02:50.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 535234 16.96 MB/sec execute 55 sec latency 33.393 ms 2024-02-19T22:02:50.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 305590 9.15 MB/sec execute 59 sec latency 5.945 ms 2024-02-19T22:02:51.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 538070 16.97 MB/sec execute 56 sec latency 33.660 ms 2024-02-19T22:02:51.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 307374 9.11 MB/sec execute 60 sec latency 11.509 ms 2024-02-19T22:02:52.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:50.430420+0000 mgr.smithi099.zfglya (mgr.14180) 391 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 131 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.4 MiB/s wr, 202 op/s 2024-02-19T22:02:52.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:50.430420+0000 mgr.smithi099.zfglya (mgr.14180) 391 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 131 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.4 MiB/s wr, 202 op/s 2024-02-19T22:02:52.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 540903 16.93 MB/sec execute 57 sec latency 54.748 ms 2024-02-19T22:02:52.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 309051 9.17 MB/sec execute 61 sec latency 4.056 ms 2024-02-19T22:02:53.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 544333 16.96 MB/sec execute 58 sec latency 33.336 ms 2024-02-19T22:02:53.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 310764 9.11 MB/sec execute 62 sec latency 9.351 ms 2024-02-19T22:02:54.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:52.430897+0000 mgr.smithi099.zfglya (mgr.14180) 392 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 131 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.2 MiB/s wr, 197 op/s 2024-02-19T22:02:54.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:52.430897+0000 mgr.smithi099.zfglya (mgr.14180) 392 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 131 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.2 MiB/s wr, 197 op/s 2024-02-19T22:02:54.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 547870 17.00 MB/sec execute 59 sec latency 33.803 ms 2024-02-19T22:02:54.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 312541 9.18 MB/sec execute 63 sec latency 9.295 ms 2024-02-19T22:02:55.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 551302 17.03 MB/sec execute 60 sec latency 66.730 ms 2024-02-19T22:02:55.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 314193 9.12 MB/sec execute 64 sec latency 10.557 ms 2024-02-19T22:02:56.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:54.431308+0000 mgr.smithi099.zfglya (mgr.14180) 393 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 133 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 203 op/s 2024-02-19T22:02:56.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:54.431308+0000 mgr.smithi099.zfglya (mgr.14180) 393 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 133 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 203 op/s 2024-02-19T22:02:56.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 554839 17.06 MB/sec execute 61 sec latency 41.583 ms 2024-02-19T22:02:56.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 316003 9.19 MB/sec execute 65 sec latency 5.490 ms 2024-02-19T22:02:57.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 555798 16.87 MB/sec execute 62 sec latency 314.434 ms 2024-02-19T22:02:57.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 317575 9.13 MB/sec execute 66 sec latency 15.726 ms 2024-02-19T22:02:58.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:56.431789+0000 mgr.smithi099.zfglya (mgr.14180) 394 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 134 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.0 MiB/s wr, 185 op/s 2024-02-19T22:02:58.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:56.431789+0000 mgr.smithi099.zfglya (mgr.14180) 394 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 134 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.0 MiB/s wr, 185 op/s 2024-02-19T22:02:58.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 558632 16.83 MB/sec execute 63 sec latency 41.519 ms 2024-02-19T22:02:58.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 319470 9.20 MB/sec execute 67 sec latency 12.964 ms 2024-02-19T22:02:59.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 562066 16.86 MB/sec execute 64 sec latency 26.421 ms 2024-02-19T22:02:59.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 320953 9.14 MB/sec execute 68 sec latency 19.486 ms 2024-02-19T22:03:00.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:02:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:02:58.432285+0000 mgr.smithi099.zfglya (mgr.14180) 395 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 135 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.8 MiB/s wr, 205 op/s 2024-02-19T22:03:00.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:02:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:02:58.432285+0000 mgr.smithi099.zfglya (mgr.14180) 395 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 135 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.8 MiB/s wr, 205 op/s 2024-02-19T22:03:00.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 565595 16.90 MB/sec execute 65 sec latency 50.082 ms 2024-02-19T22:03:00.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 322798 9.19 MB/sec execute 69 sec latency 13.389 ms 2024-02-19T22:03:01.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 569082 16.93 MB/sec execute 66 sec latency 33.701 ms 2024-02-19T22:03:01.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 324290 9.15 MB/sec execute 70 sec latency 10.823 ms 2024-02-19T22:03:02.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:00.432747+0000 mgr.smithi099.zfglya (mgr.14180) 396 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 135 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.4 MiB/s wr, 214 op/s 2024-02-19T22:03:02.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:00.432747+0000 mgr.smithi099.zfglya (mgr.14180) 396 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 135 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.4 MiB/s wr, 214 op/s 2024-02-19T22:03:02.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 572573 16.96 MB/sec execute 67 sec latency 33.728 ms 2024-02-19T22:03:02.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 326118 9.16 MB/sec execute 71 sec latency 5.316 ms 2024-02-19T22:03:03.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 575223 16.92 MB/sec execute 68 sec latency 50.038 ms 2024-02-19T22:03:03.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 327494 9.12 MB/sec execute 72 sec latency 10.506 ms 2024-02-19T22:03:04.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:02.433184+0000 mgr.smithi099.zfglya (mgr.14180) 397 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 139 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.2 MiB/s wr, 208 op/s 2024-02-19T22:03:04.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:03:03.218578+0000 mon.smithi099 (mon.0) 746 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:03:04.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:03:03.484294+0000 mon.smithi099 (mon.0) 747 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:03:04.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:03:03.805139+0000 mon.smithi099 (mon.0) 748 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:03:04.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:03:03.805819+0000 mon.smithi099 (mon.0) 749 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:03:04.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:03:03.809939+0000 mon.smithi099 (mon.0) 750 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:03:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:02.433184+0000 mgr.smithi099.zfglya (mgr.14180) 397 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 139 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.2 MiB/s wr, 208 op/s 2024-02-19T22:03:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:03:03.218578+0000 mon.smithi099 (mon.0) 746 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:03:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:03:03.484294+0000 mon.smithi099 (mon.0) 747 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:03:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:03:03.805139+0000 mon.smithi099 (mon.0) 748 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:03:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:03:03.805819+0000 mon.smithi099 (mon.0) 749 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:03:04.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:03:03.809939+0000 mon.smithi099 (mon.0) 750 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:03:04.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 578630 16.94 MB/sec execute 69 sec latency 33.382 ms 2024-02-19T22:03:04.773 INFO:tasks.workunit.client.1.smithi138.stdout: 1 329347 9.14 MB/sec execute 73 sec latency 15.801 ms 2024-02-19T22:03:05.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 581455 16.89 MB/sec execute 70 sec latency 41.803 ms 2024-02-19T22:03:05.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 330814 9.12 MB/sec execute 74 sec latency 12.224 ms 2024-02-19T22:03:06.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:04.433627+0000 mgr.smithi099.zfglya (mgr.14180) 398 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 138 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.1 MiB/s wr, 199 op/s 2024-02-19T22:03:06.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:04.433627+0000 mgr.smithi099.zfglya (mgr.14180) 398 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 138 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.1 MiB/s wr, 199 op/s 2024-02-19T22:03:06.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 584425 16.89 MB/sec execute 71 sec latency 41.558 ms 2024-02-19T22:03:06.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 332500 9.09 MB/sec execute 75 sec latency 9.867 ms 2024-02-19T22:03:07.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 587709 16.92 MB/sec execute 72 sec latency 31.165 ms 2024-02-19T22:03:07.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 334112 9.12 MB/sec execute 76 sec latency 8.236 ms 2024-02-19T22:03:08.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:06.434106+0000 mgr.smithi099.zfglya (mgr.14180) 399 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 143 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.2 MiB/s wr, 213 op/s 2024-02-19T22:03:08.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:06.434106+0000 mgr.smithi099.zfglya (mgr.14180) 399 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 143 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.2 MiB/s wr, 213 op/s 2024-02-19T22:03:08.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 590544 16.88 MB/sec execute 73 sec latency 49.909 ms 2024-02-19T22:03:08.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 335818 9.09 MB/sec execute 77 sec latency 19.200 ms 2024-02-19T22:03:09.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 593974 16.91 MB/sec execute 74 sec latency 30.373 ms 2024-02-19T22:03:09.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 337437 9.13 MB/sec execute 78 sec latency 10.369 ms 2024-02-19T22:03:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:08.434538+0000 mgr.smithi099.zfglya (mgr.14180) 400 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 143 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-02-19T22:03:10.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:08.434538+0000 mgr.smithi099.zfglya (mgr.14180) 400 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 143 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-02-19T22:03:10.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 597514 16.94 MB/sec execute 75 sec latency 27.134 ms 2024-02-19T22:03:10.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 339071 9.09 MB/sec execute 79 sec latency 19.163 ms 2024-02-19T22:03:11.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 600989 16.97 MB/sec execute 76 sec latency 55.877 ms 2024-02-19T22:03:11.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 340822 9.14 MB/sec execute 80 sec latency 11.177 ms 2024-02-19T22:03:12.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:10.435250+0000 mgr.smithi099.zfglya (mgr.14180) 401 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 142 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 180 op/s 2024-02-19T22:03:12.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:10.435250+0000 mgr.smithi099.zfglya (mgr.14180) 401 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 142 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 180 op/s 2024-02-19T22:03:12.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 604487 16.99 MB/sec execute 77 sec latency 33.211 ms 2024-02-19T22:03:12.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 342329 9.09 MB/sec execute 81 sec latency 9.965 ms 2024-02-19T22:03:13.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 608021 17.02 MB/sec execute 78 sec latency 25.174 ms 2024-02-19T22:03:13.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 344143 9.13 MB/sec execute 82 sec latency 10.772 ms 2024-02-19T22:03:14.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:12.435744+0000 mgr.smithi099.zfglya (mgr.14180) 402 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 144 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.3 MiB/s wr, 227 op/s 2024-02-19T22:03:14.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:12.435744+0000 mgr.smithi099.zfglya (mgr.14180) 402 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 144 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.3 MiB/s wr, 227 op/s 2024-02-19T22:03:14.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 610343 16.96 MB/sec execute 79 sec latency 57.862 ms 2024-02-19T22:03:14.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 345626 9.10 MB/sec execute 83 sec latency 9.256 ms 2024-02-19T22:03:15.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 613372 16.93 MB/sec execute 80 sec latency 35.896 ms 2024-02-19T22:03:15.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 347422 9.11 MB/sec execute 84 sec latency 13.347 ms 2024-02-19T22:03:16.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:14.436210+0000 mgr.smithi099.zfglya (mgr.14180) 403 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 145 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.9 MiB/s wr, 178 op/s 2024-02-19T22:03:16.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:14.436210+0000 mgr.smithi099.zfglya (mgr.14180) 403 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 145 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.9 MiB/s wr, 178 op/s 2024-02-19T22:03:16.612 INFO:tasks.workunit.client.0.smithi099.stdout: 1 616331 16.93 MB/sec execute 81 sec latency 59.039 ms 2024-02-19T22:03:16.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 348898 9.08 MB/sec execute 85 sec latency 9.646 ms 2024-02-19T22:03:17.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 619621 16.95 MB/sec execute 82 sec latency 27.313 ms 2024-02-19T22:03:17.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 350893 9.11 MB/sec execute 86 sec latency 14.819 ms 2024-02-19T22:03:18.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:16.436829+0000 mgr.smithi099.zfglya (mgr.14180) 404 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 146 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 190 op/s 2024-02-19T22:03:18.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:16.436829+0000 mgr.smithi099.zfglya (mgr.14180) 404 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 146 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 190 op/s 2024-02-19T22:03:18.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 620463 16.78 MB/sec execute 83 sec latency 549.845 ms 2024-02-19T22:03:18.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 352194 9.09 MB/sec execute 87 sec latency 8.571 ms 2024-02-19T22:03:19.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 622328 16.72 MB/sec execute 84 sec latency 358.145 ms 2024-02-19T22:03:19.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 353920 9.09 MB/sec execute 88 sec latency 14.691 ms 2024-02-19T22:03:20.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:18.437281+0000 mgr.smithi099.zfglya (mgr.14180) 405 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 148 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.5 MiB/s wr, 152 op/s 2024-02-19T22:03:20.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:18.437281+0000 mgr.smithi099.zfglya (mgr.14180) 405 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 148 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.5 MiB/s wr, 152 op/s 2024-02-19T22:03:20.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 625877 16.75 MB/sec execute 85 sec latency 26.794 ms 2024-02-19T22:03:20.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 355456 9.08 MB/sec execute 89 sec latency 10.141 ms 2024-02-19T22:03:21.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 629426 16.77 MB/sec execute 86 sec latency 25.142 ms 2024-02-19T22:03:21.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 357201 9.06 MB/sec execute 90 sec latency 10.131 ms 2024-02-19T22:03:22.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:20.437860+0000 mgr.smithi099.zfglya (mgr.14180) 406 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 149 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.2 MiB/s wr, 194 op/s 2024-02-19T22:03:22.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:20.437860+0000 mgr.smithi099.zfglya (mgr.14180) 406 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 149 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.2 MiB/s wr, 194 op/s 2024-02-19T22:03:22.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 632979 16.80 MB/sec execute 87 sec latency 45.835 ms 2024-02-19T22:03:22.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 358868 9.09 MB/sec execute 91 sec latency 11.542 ms 2024-02-19T22:03:23.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 636593 16.83 MB/sec execute 88 sec latency 41.608 ms 2024-02-19T22:03:23.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 360613 9.06 MB/sec execute 92 sec latency 7.065 ms 2024-02-19T22:03:24.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:22.438381+0000 mgr.smithi099.zfglya (mgr.14180) 407 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 151 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.2 MiB/s wr, 197 op/s 2024-02-19T22:03:24.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:22.438381+0000 mgr.smithi099.zfglya (mgr.14180) 407 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 151 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.2 MiB/s wr, 197 op/s 2024-02-19T22:03:24.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 640062 16.85 MB/sec execute 89 sec latency 50.082 ms 2024-02-19T22:03:24.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 362257 9.10 MB/sec execute 93 sec latency 5.128 ms 2024-02-19T22:03:25.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 643605 16.88 MB/sec execute 90 sec latency 25.216 ms 2024-02-19T22:03:25.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 363958 9.06 MB/sec execute 94 sec latency 8.368 ms 2024-02-19T22:03:26.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:24.438830+0000 mgr.smithi099.zfglya (mgr.14180) 408 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 153 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.1 MiB/s wr, 182 op/s 2024-02-19T22:03:26.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:24.438830+0000 mgr.smithi099.zfglya (mgr.14180) 408 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 153 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.1 MiB/s wr, 182 op/s 2024-02-19T22:03:26.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 647155 16.90 MB/sec execute 91 sec latency 25.262 ms 2024-02-19T22:03:26.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 365680 9.11 MB/sec execute 95 sec latency 10.930 ms 2024-02-19T22:03:27.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 650698 16.93 MB/sec execute 92 sec latency 43.416 ms 2024-02-19T22:03:27.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 367249 9.07 MB/sec execute 96 sec latency 13.130 ms 2024-02-19T22:03:28.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:26.439301+0000 mgr.smithi099.zfglya (mgr.14180) 409 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 152 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 195 op/s 2024-02-19T22:03:28.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:26.439301+0000 mgr.smithi099.zfglya (mgr.14180) 409 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 152 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 195 op/s 2024-02-19T22:03:28.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 654253 16.95 MB/sec execute 93 sec latency 27.691 ms 2024-02-19T22:03:28.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 369106 9.11 MB/sec execute 97 sec latency 9.046 ms 2024-02-19T22:03:29.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 657785 16.97 MB/sec execute 94 sec latency 72.944 ms 2024-02-19T22:03:29.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 370575 9.08 MB/sec execute 98 sec latency 10.388 ms 2024-02-19T22:03:30.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:28.439703+0000 mgr.smithi099.zfglya (mgr.14180) 410 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 151 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.6 MiB/s wr, 184 op/s 2024-02-19T22:03:30.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:28.439703+0000 mgr.smithi099.zfglya (mgr.14180) 410 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 151 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.6 MiB/s wr, 184 op/s 2024-02-19T22:03:30.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 661215 16.99 MB/sec execute 95 sec latency 158.257 ms 2024-02-19T22:03:30.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 372440 9.11 MB/sec execute 99 sec latency 7.487 ms 2024-02-19T22:03:31.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 664757 17.02 MB/sec execute 96 sec latency 41.726 ms 2024-02-19T22:03:31.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 373879 9.08 MB/sec execute 100 sec latency 11.118 ms 2024-02-19T22:03:32.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:30.440182+0000 mgr.smithi099.zfglya (mgr.14180) 411 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 154 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.4 MiB/s wr, 232 op/s 2024-02-19T22:03:32.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:30.440182+0000 mgr.smithi099.zfglya (mgr.14180) 411 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 154 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.4 MiB/s wr, 232 op/s 2024-02-19T22:03:32.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 668301 17.04 MB/sec execute 97 sec latency 52.234 ms 2024-02-19T22:03:32.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 375740 9.09 MB/sec execute 101 sec latency 15.537 ms 2024-02-19T22:03:33.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 671846 17.06 MB/sec execute 98 sec latency 27.321 ms 2024-02-19T22:03:33.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 377139 9.06 MB/sec execute 102 sec latency 11.676 ms 2024-02-19T22:03:34.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:32.440620+0000 mgr.smithi099.zfglya (mgr.14180) 412 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 155 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.1 MiB/s wr, 201 op/s 2024-02-19T22:03:34.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:32.440620+0000 mgr.smithi099.zfglya (mgr.14180) 412 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 155 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.2 KiB/s rd, 4.1 MiB/s wr, 201 op/s 2024-02-19T22:03:34.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 675455 17.08 MB/sec execute 99 sec latency 27.824 ms 2024-02-19T22:03:34.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 379028 9.08 MB/sec execute 103 sec latency 12.227 ms 2024-02-19T22:03:35.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 678995 17.10 MB/sec execute 100 sec latency 47.530 ms 2024-02-19T22:03:35.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 380529 9.06 MB/sec execute 104 sec latency 5.601 ms 2024-02-19T22:03:36.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:34.441040+0000 mgr.smithi099.zfglya (mgr.14180) 413 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 156 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.9 MiB/s wr, 186 op/s 2024-02-19T22:03:36.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:34.441040+0000 mgr.smithi099.zfglya (mgr.14180) 413 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 156 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.9 MiB/s wr, 186 op/s 2024-02-19T22:03:36.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 682590 17.12 MB/sec execute 101 sec latency 33.708 ms 2024-02-19T22:03:36.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 382320 9.07 MB/sec execute 105 sec latency 9.351 ms 2024-02-19T22:03:37.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 686137 17.14 MB/sec execute 102 sec latency 27.742 ms 2024-02-19T22:03:37.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 383862 9.07 MB/sec execute 106 sec latency 11.904 ms 2024-02-19T22:03:38.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:36.441486+0000 mgr.smithi099.zfglya (mgr.14180) 414 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 160 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.9 MiB/s wr, 187 op/s 2024-02-19T22:03:38.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:36.441486+0000 mgr.smithi099.zfglya (mgr.14180) 414 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 160 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.9 MiB/s wr, 187 op/s 2024-02-19T22:03:38.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 689688 17.16 MB/sec execute 103 sec latency 49.382 ms 2024-02-19T22:03:38.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 385607 9.05 MB/sec execute 107 sec latency 20.150 ms 2024-02-19T22:03:39.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 693233 17.18 MB/sec execute 104 sec latency 32.217 ms 2024-02-19T22:03:39.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 387246 9.07 MB/sec execute 108 sec latency 5.935 ms 2024-02-19T22:03:40.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:38.441870+0000 mgr.smithi099.zfglya (mgr.14180) 415 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 159 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.6 MiB/s wr, 177 op/s 2024-02-19T22:03:40.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:38.441870+0000 mgr.smithi099.zfglya (mgr.14180) 415 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 159 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.6 MiB/s wr, 177 op/s 2024-02-19T22:03:40.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 696785 17.20 MB/sec execute 105 sec latency 33.429 ms 2024-02-19T22:03:40.774 INFO:tasks.workunit.client.1.smithi138.stdout: 1 388983 9.05 MB/sec execute 109 sec latency 10.764 ms 2024-02-19T22:03:41.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 700327 17.22 MB/sec execute 106 sec latency 43.209 ms 2024-02-19T22:03:41.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 390632 9.08 MB/sec execute 110 sec latency 13.454 ms 2024-02-19T22:03:42.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:40.442363+0000 mgr.smithi099.zfglya (mgr.14180) 416 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 162 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.5 MiB/s wr, 222 op/s 2024-02-19T22:03:42.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:40.442363+0000 mgr.smithi099.zfglya (mgr.14180) 416 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 162 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.5 MiB/s wr, 222 op/s 2024-02-19T22:03:42.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 703931 17.24 MB/sec execute 107 sec latency 32.386 ms 2024-02-19T22:03:42.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 392284 9.05 MB/sec execute 111 sec latency 7.101 ms 2024-02-19T22:03:43.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 707474 17.25 MB/sec execute 108 sec latency 49.940 ms 2024-02-19T22:03:43.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 394073 9.09 MB/sec execute 112 sec latency 12.004 ms 2024-02-19T22:03:44.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:42.442798+0000 mgr.smithi099.zfglya (mgr.14180) 417 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 162 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.1 MiB/s wr, 180 op/s 2024-02-19T22:03:44.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:42.442798+0000 mgr.smithi099.zfglya (mgr.14180) 417 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 162 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.1 MiB/s wr, 180 op/s 2024-02-19T22:03:44.613 INFO:tasks.workunit.client.0.smithi099.stdout: 1 711029 17.27 MB/sec execute 109 sec latency 33.019 ms 2024-02-19T22:03:44.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 395635 9.06 MB/sec execute 113 sec latency 21.231 ms 2024-02-19T22:03:45.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 714577 17.29 MB/sec execute 110 sec latency 27.308 ms 2024-02-19T22:03:45.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 397451 9.09 MB/sec execute 114 sec latency 11.836 ms 2024-02-19T22:03:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:44.443207+0000 mgr.smithi099.zfglya (mgr.14180) 418 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 163 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.2 MiB/s wr, 188 op/s 2024-02-19T22:03:46.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:44.443207+0000 mgr.smithi099.zfglya (mgr.14180) 418 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 163 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.2 MiB/s wr, 188 op/s 2024-02-19T22:03:46.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 718197 17.31 MB/sec execute 111 sec latency 45.511 ms 2024-02-19T22:03:46.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 398921 9.06 MB/sec execute 115 sec latency 14.623 ms 2024-02-19T22:03:47.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 721740 17.32 MB/sec execute 112 sec latency 41.841 ms 2024-02-19T22:03:47.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 400704 9.07 MB/sec execute 116 sec latency 7.634 ms 2024-02-19T22:03:48.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:46.443880+0000 mgr.smithi099.zfglya (mgr.14180) 419 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 163 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.1 MiB/s wr, 199 op/s 2024-02-19T22:03:48.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:46.443880+0000 mgr.smithi099.zfglya (mgr.14180) 419 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 163 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.1 MiB/s wr, 199 op/s 2024-02-19T22:03:48.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 725291 17.34 MB/sec execute 113 sec latency 30.766 ms 2024-02-19T22:03:48.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 402313 9.07 MB/sec execute 117 sec latency 12.817 ms 2024-02-19T22:03:49.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 728833 17.35 MB/sec execute 114 sec latency 51.886 ms 2024-02-19T22:03:49.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 404174 9.07 MB/sec execute 118 sec latency 9.896 ms 2024-02-19T22:03:50.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:48.444296+0000 mgr.smithi099.zfglya (mgr.14180) 420 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 165 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.2 KiB/s rd, 3.8 MiB/s wr, 197 op/s 2024-02-19T22:03:50.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:48.444296+0000 mgr.smithi099.zfglya (mgr.14180) 420 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 165 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.2 KiB/s rd, 3.8 MiB/s wr, 197 op/s 2024-02-19T22:03:50.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 731141 17.31 MB/sec execute 115 sec latency 444.909 ms 2024-02-19T22:03:50.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 405621 9.06 MB/sec execute 119 sec latency 9.804 ms 2024-02-19T22:03:51.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 732230 17.22 MB/sec execute 116 sec latency 357.927 ms 2024-02-19T22:03:51.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 407669 9.08 MB/sec execute 120 sec latency 15.963 ms 2024-02-19T22:03:52.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:50.444790+0000 mgr.smithi099.zfglya (mgr.14180) 421 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 166 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.5 MiB/s wr, 216 op/s 2024-02-19T22:03:52.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:50.444790+0000 mgr.smithi099.zfglya (mgr.14180) 421 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 166 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.5 MiB/s wr, 216 op/s 2024-02-19T22:03:52.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 735721 17.23 MB/sec execute 117 sec latency 33.235 ms 2024-02-19T22:03:52.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 409011 9.06 MB/sec execute 121 sec latency 7.363 ms 2024-02-19T22:03:53.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 739164 17.24 MB/sec execute 118 sec latency 33.564 ms 2024-02-19T22:03:53.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 410884 9.08 MB/sec execute 122 sec latency 15.057 ms 2024-02-19T22:03:54.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:52.445284+0000 mgr.smithi099.zfglya (mgr.14180) 422 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 168 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 4.0 MiB/s wr, 191 op/s 2024-02-19T22:03:54.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:52.445284+0000 mgr.smithi099.zfglya (mgr.14180) 422 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 168 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 4.0 MiB/s wr, 191 op/s 2024-02-19T22:03:54.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 741780 17.21 MB/sec execute 119 sec latency 48.820 ms 2024-02-19T22:03:54.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 412382 9.06 MB/sec execute 123 sec latency 9.452 ms 2024-02-19T22:03:55.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 744547 17.18 MB/sec execute 120 sec latency 75.022 ms 2024-02-19T22:03:55.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 414094 9.05 MB/sec execute 124 sec latency 10.694 ms 2024-02-19T22:03:56.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:54.445766+0000 mgr.smithi099.zfglya (mgr.14180) 423 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 171 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.3 MiB/s wr, 210 op/s 2024-02-19T22:03:56.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:54.445766+0000 mgr.smithi099.zfglya (mgr.14180) 423 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 171 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.3 MiB/s wr, 210 op/s 2024-02-19T22:03:56.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 747570 17.18 MB/sec execute 121 sec latency 41.515 ms 2024-02-19T22:03:56.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 415733 9.06 MB/sec execute 125 sec latency 10.971 ms 2024-02-19T22:03:57.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 750857 17.19 MB/sec execute 122 sec latency 44.927 ms 2024-02-19T22:03:57.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 417458 9.05 MB/sec execute 126 sec latency 25.604 ms 2024-02-19T22:03:58.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:03:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:56.446282+0000 mgr.smithi099.zfglya (mgr.14180) 424 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 170 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 200 op/s 2024-02-19T22:03:58.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:03:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:56.446282+0000 mgr.smithi099.zfglya (mgr.14180) 424 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 170 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 200 op/s 2024-02-19T22:03:58.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 753695 17.17 MB/sec execute 123 sec latency 33.417 ms 2024-02-19T22:03:58.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 419085 9.07 MB/sec execute 127 sec latency 11.060 ms 2024-02-19T22:03:59.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 757127 17.19 MB/sec execute 124 sec latency 54.966 ms 2024-02-19T22:03:59.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 420768 9.05 MB/sec execute 128 sec latency 16.671 ms 2024-02-19T22:04:00.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:03:58.446687+0000 mgr.smithi099.zfglya (mgr.14180) 425 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 170 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.7 MiB/s wr, 192 op/s 2024-02-19T22:04:00.462 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:03:58.446687+0000 mgr.smithi099.zfglya (mgr.14180) 425 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 170 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.7 MiB/s wr, 192 op/s 2024-02-19T22:04:00.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 760669 17.20 MB/sec execute 125 sec latency 26.929 ms 2024-02-19T22:04:00.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 422485 9.08 MB/sec execute 129 sec latency 5.286 ms 2024-02-19T22:04:01.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 764149 17.22 MB/sec execute 126 sec latency 33.683 ms 2024-02-19T22:04:01.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 424037 9.05 MB/sec execute 130 sec latency 10.214 ms 2024-02-19T22:04:02.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:00.447135+0000 mgr.smithi099.zfglya (mgr.14180) 426 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 172 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 4.3 MiB/s wr, 199 op/s 2024-02-19T22:04:02.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:00.447135+0000 mgr.smithi099.zfglya (mgr.14180) 426 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 172 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 4.3 MiB/s wr, 199 op/s 2024-02-19T22:04:02.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 766703 17.19 MB/sec execute 127 sec latency 245.789 ms 2024-02-19T22:04:02.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 425884 9.08 MB/sec execute 131 sec latency 12.740 ms 2024-02-19T22:04:03.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 769877 17.19 MB/sec execute 128 sec latency 33.349 ms 2024-02-19T22:04:03.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 427322 9.06 MB/sec execute 132 sec latency 8.655 ms 2024-02-19T22:04:04.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:02.447569+0000 mgr.smithi099.zfglya (mgr.14180) 427 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 173 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.1 MiB/s wr, 190 op/s 2024-02-19T22:04:04.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:04:03.815427+0000 mon.smithi099 (mon.0) 751 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:04:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:02.447569+0000 mgr.smithi099.zfglya (mgr.14180) 427 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 173 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.1 MiB/s wr, 190 op/s 2024-02-19T22:04:04.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:04:03.815427+0000 mon.smithi099 (mon.0) 751 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:04:04.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 772917 17.16 MB/sec execute 129 sec latency 27.398 ms 2024-02-19T22:04:04.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 429046 9.06 MB/sec execute 133 sec latency 13.569 ms 2024-02-19T22:04:05.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:04:04.146009+0000 mon.smithi099 (mon.0) 752 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:04:05.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:04:04.146653+0000 mon.smithi099 (mon.0) 753 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:04:05.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:04:04.150826+0000 mon.smithi099 (mon.0) 754 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:04:05.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:04:04.146009+0000 mon.smithi099 (mon.0) 752 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:04:05.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:04:04.146653+0000 mon.smithi099 (mon.0) 753 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:04:05.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:04:04.150826+0000 mon.smithi099 (mon.0) 754 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:04:05.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 775686 17.16 MB/sec execute 130 sec latency 55.900 ms 2024-02-19T22:04:05.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 430477 9.04 MB/sec execute 134 sec latency 9.811 ms 2024-02-19T22:04:06.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:04.447987+0000 mgr.smithi099.zfglya (mgr.14180) 428 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 174 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.1 MiB/s wr, 195 op/s 2024-02-19T22:04:06.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:04.447987+0000 mgr.smithi099.zfglya (mgr.14180) 428 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 174 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.1 MiB/s wr, 195 op/s 2024-02-19T22:04:06.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 778517 17.15 MB/sec execute 131 sec latency 33.428 ms 2024-02-19T22:04:06.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 432396 9.06 MB/sec execute 135 sec latency 9.366 ms 2024-02-19T22:04:07.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 781948 17.16 MB/sec execute 132 sec latency 49.851 ms 2024-02-19T22:04:07.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 433705 9.04 MB/sec execute 136 sec latency 12.907 ms 2024-02-19T22:04:08.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:06.448482+0000 mgr.smithi099.zfglya (mgr.14180) 429 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 178 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.1 MiB/s wr, 200 op/s 2024-02-19T22:04:08.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:06.448482+0000 mgr.smithi099.zfglya (mgr.14180) 429 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 178 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.1 MiB/s wr, 200 op/s 2024-02-19T22:04:08.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 785482 17.17 MB/sec execute 133 sec latency 33.393 ms 2024-02-19T22:04:08.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 435346 9.03 MB/sec execute 137 sec latency 10.610 ms 2024-02-19T22:04:09.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 788969 17.19 MB/sec execute 134 sec latency 27.902 ms 2024-02-19T22:04:09.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 436979 9.04 MB/sec execute 138 sec latency 8.632 ms 2024-02-19T22:04:10.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:08.448917+0000 mgr.smithi099.zfglya (mgr.14180) 430 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 179 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.9 MiB/s wr, 190 op/s 2024-02-19T22:04:10.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:08.448917+0000 mgr.smithi099.zfglya (mgr.14180) 430 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 179 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.9 MiB/s wr, 190 op/s 2024-02-19T22:04:10.614 INFO:tasks.workunit.client.0.smithi099.stdout: 1 792458 17.20 MB/sec execute 135 sec latency 49.111 ms 2024-02-19T22:04:10.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 438703 9.03 MB/sec execute 139 sec latency 15.269 ms 2024-02-19T22:04:11.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 795997 17.21 MB/sec execute 136 sec latency 26.278 ms 2024-02-19T22:04:11.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 440338 9.05 MB/sec execute 140 sec latency 3.967 ms 2024-02-19T22:04:12.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:10.449384+0000 mgr.smithi099.zfglya (mgr.14180) 431 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 177 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 199 op/s 2024-02-19T22:04:12.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:10.449384+0000 mgr.smithi099.zfglya (mgr.14180) 431 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 177 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 199 op/s 2024-02-19T22:04:12.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 798614 17.19 MB/sec execute 137 sec latency 33.466 ms 2024-02-19T22:04:12.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 442034 9.02 MB/sec execute 141 sec latency 10.355 ms 2024-02-19T22:04:13.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 801630 17.18 MB/sec execute 138 sec latency 48.913 ms 2024-02-19T22:04:13.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 443780 9.05 MB/sec execute 142 sec latency 5.039 ms 2024-02-19T22:04:14.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:12.449821+0000 mgr.smithi099.zfglya (mgr.14180) 432 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 180 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.1 MiB/s wr, 211 op/s 2024-02-19T22:04:14.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:12.449821+0000 mgr.smithi099.zfglya (mgr.14180) 432 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 180 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.1 MiB/s wr, 211 op/s 2024-02-19T22:04:14.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 804757 17.17 MB/sec execute 139 sec latency 41.533 ms 2024-02-19T22:04:14.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 445384 9.03 MB/sec execute 143 sec latency 12.143 ms 2024-02-19T22:04:15.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 807592 17.17 MB/sec execute 140 sec latency 55.672 ms 2024-02-19T22:04:15.775 INFO:tasks.workunit.client.1.smithi138.stdout: 1 447202 9.06 MB/sec execute 144 sec latency 12.494 ms 2024-02-19T22:04:16.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:14.450249+0000 mgr.smithi099.zfglya (mgr.14180) 433 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 181 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 199 op/s 2024-02-19T22:04:16.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:14.450249+0000 mgr.smithi099.zfglya (mgr.14180) 433 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 181 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 199 op/s 2024-02-19T22:04:16.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 810428 17.15 MB/sec execute 141 sec latency 27.900 ms 2024-02-19T22:04:16.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 448757 9.04 MB/sec execute 145 sec latency 8.793 ms 2024-02-19T22:04:17.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 813857 17.16 MB/sec execute 142 sec latency 33.650 ms 2024-02-19T22:04:17.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 450626 9.06 MB/sec execute 146 sec latency 12.697 ms 2024-02-19T22:04:18.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:16.450741+0000 mgr.smithi099.zfglya (mgr.14180) 434 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 181 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.9 MiB/s wr, 186 op/s 2024-02-19T22:04:18.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:16.450741+0000 mgr.smithi099.zfglya (mgr.14180) 434 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 181 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.9 MiB/s wr, 186 op/s 2024-02-19T22:04:18.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 817396 17.18 MB/sec execute 143 sec latency 52.770 ms 2024-02-19T22:04:18.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 452142 9.04 MB/sec execute 147 sec latency 12.564 ms 2024-02-19T22:04:19.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 820877 17.19 MB/sec execute 144 sec latency 27.897 ms 2024-02-19T22:04:19.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 454044 9.06 MB/sec execute 148 sec latency 11.556 ms 2024-02-19T22:04:20.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:18.451148+0000 mgr.smithi099.zfglya (mgr.14180) 435 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 182 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.5 MiB/s wr, 168 op/s 2024-02-19T22:04:20.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:18.451148+0000 mgr.smithi099.zfglya (mgr.14180) 435 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 182 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.1 KiB/s rd, 3.5 MiB/s wr, 168 op/s 2024-02-19T22:04:20.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 824416 17.20 MB/sec execute 145 sec latency 33.684 ms 2024-02-19T22:04:20.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 455556 9.05 MB/sec execute 149 sec latency 13.634 ms 2024-02-19T22:04:21.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 827911 17.21 MB/sec execute 146 sec latency 50.044 ms 2024-02-19T22:04:21.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 457367 9.05 MB/sec execute 150 sec latency 11.197 ms 2024-02-19T22:04:22.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:20.451649+0000 mgr.smithi099.zfglya (mgr.14180) 436 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 205 op/s 2024-02-19T22:04:22.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:20.451649+0000 mgr.smithi099.zfglya (mgr.14180) 436 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 205 op/s 2024-02-19T22:04:22.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 829575 17.14 MB/sec execute 147 sec latency 306.654 ms 2024-02-19T22:04:22.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 458829 9.14 MB/sec execute 151 sec latency 15.027 ms 2024-02-19T22:04:23.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 829707 17.03 MB/sec execute 148 sec latency 405.335 ms 2024-02-19T22:04:23.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 460647 9.15 MB/sec execute 152 sec latency 15.171 ms 2024-02-19T22:04:24.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:22.452154+0000 mgr.smithi099.zfglya (mgr.14180) 437 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.3 MiB/s wr, 205 op/s 2024-02-19T22:04:24.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:22.452154+0000 mgr.smithi099.zfglya (mgr.14180) 437 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.3 MiB/s wr, 205 op/s 2024-02-19T22:04:24.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 832413 17.03 MB/sec execute 149 sec latency 274.496 ms 2024-02-19T22:04:24.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 462282 9.17 MB/sec execute 153 sec latency 10.930 ms 2024-02-19T22:04:25.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 835311 17.01 MB/sec execute 150 sec latency 27.315 ms 2024-02-19T22:04:25.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 463797 9.14 MB/sec execute 154 sec latency 17.170 ms 2024-02-19T22:04:26.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:24.452654+0000 mgr.smithi099.zfglya (mgr.14180) 438 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 196 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 175 op/s 2024-02-19T22:04:26.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:24.452654+0000 mgr.smithi099.zfglya (mgr.14180) 438 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 196 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 175 op/s 2024-02-19T22:04:26.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 838793 17.03 MB/sec execute 151 sec latency 50.249 ms 2024-02-19T22:04:26.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 465610 9.16 MB/sec execute 155 sec latency 9.032 ms 2024-02-19T22:04:27.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 842261 17.04 MB/sec execute 152 sec latency 27.176 ms 2024-02-19T22:04:27.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 467058 9.15 MB/sec execute 156 sec latency 23.867 ms 2024-02-19T22:04:28.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:26.453141+0000 mgr.smithi099.zfglya (mgr.14180) 439 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 198 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 5.4 MiB/s wr, 222 op/s 2024-02-19T22:04:28.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:26.453141+0000 mgr.smithi099.zfglya (mgr.14180) 439 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 198 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 5.4 MiB/s wr, 222 op/s 2024-02-19T22:04:28.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 845826 17.05 MB/sec execute 153 sec latency 33.659 ms 2024-02-19T22:04:28.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 468808 9.15 MB/sec execute 157 sec latency 12.542 ms 2024-02-19T22:04:29.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 849303 17.07 MB/sec execute 154 sec latency 49.871 ms 2024-02-19T22:04:29.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 470280 9.13 MB/sec execute 158 sec latency 16.386 ms 2024-02-19T22:04:30.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:28.453538+0000 mgr.smithi099.zfglya (mgr.14180) 440 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 199 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.4 KiB/s rd, 5.5 MiB/s wr, 212 op/s 2024-02-19T22:04:30.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:28.453538+0000 mgr.smithi099.zfglya (mgr.14180) 440 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 199 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.4 KiB/s rd, 5.5 MiB/s wr, 212 op/s 2024-02-19T22:04:30.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 852799 17.08 MB/sec execute 155 sec latency 33.170 ms 2024-02-19T22:04:30.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 472275 9.15 MB/sec execute 159 sec latency 15.338 ms 2024-02-19T22:04:31.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 856332 17.09 MB/sec execute 156 sec latency 44.347 ms 2024-02-19T22:04:31.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 473582 9.14 MB/sec execute 160 sec latency 9.889 ms 2024-02-19T22:04:32.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:30.453995+0000 mgr.smithi099.zfglya (mgr.14180) 441 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 6.0 MiB/s wr, 203 op/s 2024-02-19T22:04:32.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:30.453995+0000 mgr.smithi099.zfglya (mgr.14180) 441 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 6.0 MiB/s wr, 203 op/s 2024-02-19T22:04:32.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 858948 17.07 MB/sec execute 157 sec latency 50.093 ms 2024-02-19T22:04:32.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 475412 9.14 MB/sec execute 161 sec latency 15.876 ms 2024-02-19T22:04:33.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 862181 17.07 MB/sec execute 158 sec latency 27.402 ms 2024-02-19T22:04:33.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 476868 9.13 MB/sec execute 162 sec latency 5.114 ms 2024-02-19T22:04:34.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:32.454536+0000 mgr.smithi099.zfglya (mgr.14180) 442 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 193 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.1 KiB/s rd, 5.7 MiB/s wr, 223 op/s 2024-02-19T22:04:34.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:32.454536+0000 mgr.smithi099.zfglya (mgr.14180) 442 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 193 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.1 KiB/s rd, 5.7 MiB/s wr, 223 op/s 2024-02-19T22:04:34.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 864382 17.04 MB/sec execute 159 sec latency 210.337 ms 2024-02-19T22:04:34.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 478562 9.12 MB/sec execute 163 sec latency 14.705 ms 2024-02-19T22:04:35.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 867219 17.03 MB/sec execute 160 sec latency 41.784 ms 2024-02-19T22:04:35.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 480159 9.14 MB/sec execute 164 sec latency 5.895 ms 2024-02-19T22:04:36.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:34.455002+0000 mgr.smithi099.zfglya (mgr.14180) 443 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 5.7 MiB/s wr, 212 op/s 2024-02-19T22:04:36.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:34.455002+0000 mgr.smithi099.zfglya (mgr.14180) 443 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 5.7 MiB/s wr, 212 op/s 2024-02-19T22:04:36.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 870648 17.04 MB/sec execute 161 sec latency 33.696 ms 2024-02-19T22:04:36.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 481887 9.12 MB/sec execute 165 sec latency 8.446 ms 2024-02-19T22:04:37.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 874185 17.05 MB/sec execute 162 sec latency 57.518 ms 2024-02-19T22:04:37.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 483606 9.14 MB/sec execute 166 sec latency 12.985 ms 2024-02-19T22:04:38.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:36.455459+0000 mgr.smithi099.zfglya (mgr.14180) 444 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.6 MiB/s wr, 196 op/s 2024-02-19T22:04:38.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:36.455459+0000 mgr.smithi099.zfglya (mgr.14180) 444 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.6 MiB/s wr, 196 op/s 2024-02-19T22:04:38.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 877669 17.06 MB/sec execute 163 sec latency 25.108 ms 2024-02-19T22:04:38.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 485233 9.12 MB/sec execute 167 sec latency 11.009 ms 2024-02-19T22:04:39.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 881210 17.07 MB/sec execute 164 sec latency 32.774 ms 2024-02-19T22:04:39.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 487031 9.14 MB/sec execute 168 sec latency 12.586 ms 2024-02-19T22:04:40.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:38.455879+0000 mgr.smithi099.zfglya (mgr.14180) 445 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.3 KiB/s rd, 3.9 MiB/s wr, 186 op/s 2024-02-19T22:04:40.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:38.455879+0000 mgr.smithi099.zfglya (mgr.14180) 445 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.3 KiB/s rd, 3.9 MiB/s wr, 186 op/s 2024-02-19T22:04:40.615 INFO:tasks.workunit.client.0.smithi099.stdout: 1 884706 17.09 MB/sec execute 165 sec latency 53.456 ms 2024-02-19T22:04:40.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 488554 9.12 MB/sec execute 169 sec latency 21.905 ms 2024-02-19T22:04:41.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 888255 17.10 MB/sec execute 166 sec latency 27.387 ms 2024-02-19T22:04:41.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 490398 9.14 MB/sec execute 170 sec latency 6.242 ms 2024-02-19T22:04:42.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:40.456417+0000 mgr.smithi099.zfglya (mgr.14180) 446 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.3 MiB/s wr, 197 op/s 2024-02-19T22:04:42.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:40.456417+0000 mgr.smithi099.zfglya (mgr.14180) 446 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.3 MiB/s wr, 197 op/s 2024-02-19T22:04:42.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 891788 17.11 MB/sec execute 167 sec latency 49.908 ms 2024-02-19T22:04:42.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 491866 9.13 MB/sec execute 171 sec latency 10.398 ms 2024-02-19T22:04:43.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 895333 17.12 MB/sec execute 168 sec latency 25.147 ms 2024-02-19T22:04:43.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 493655 9.13 MB/sec execute 172 sec latency 4.398 ms 2024-02-19T22:04:44.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:42.456878+0000 mgr.smithi099.zfglya (mgr.14180) 447 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.1 MiB/s wr, 229 op/s 2024-02-19T22:04:44.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:42.456878+0000 mgr.smithi099.zfglya (mgr.14180) 447 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.1 MiB/s wr, 229 op/s 2024-02-19T22:04:44.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 897951 17.10 MB/sec execute 169 sec latency 33.645 ms 2024-02-19T22:04:44.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 495139 9.12 MB/sec execute 173 sec latency 8.023 ms 2024-02-19T22:04:45.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 901104 17.10 MB/sec execute 170 sec latency 45.980 ms 2024-02-19T22:04:45.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 497134 9.13 MB/sec execute 174 sec latency 14.832 ms 2024-02-19T22:04:46.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:44.457311+0000 mgr.smithi099.zfglya (mgr.14180) 448 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 172 op/s 2024-02-19T22:04:46.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:44.457311+0000 mgr.smithi099.zfglya (mgr.14180) 448 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 172 op/s 2024-02-19T22:04:46.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 904126 17.08 MB/sec execute 171 sec latency 41.334 ms 2024-02-19T22:04:46.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 498470 9.12 MB/sec execute 175 sec latency 4.607 ms 2024-02-19T22:04:47.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:46.457735+0000 mgr.smithi099.zfglya (mgr.14180) 449 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.9 MiB/s wr, 185 op/s 2024-02-19T22:04:47.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 906930 17.09 MB/sec execute 172 sec latency 58.404 ms 2024-02-19T22:04:47.698 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:46.457735+0000 mgr.smithi099.zfglya (mgr.14180) 449 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.9 MiB/s wr, 185 op/s 2024-02-19T22:04:47.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 500329 9.13 MB/sec execute 176 sec latency 10.803 ms 2024-02-19T22:04:48.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 909829 17.07 MB/sec execute 173 sec latency 54.748 ms 2024-02-19T22:04:48.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 501805 9.12 MB/sec execute 177 sec latency 8.246 ms 2024-02-19T22:04:49.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 913308 17.08 MB/sec execute 174 sec latency 33.369 ms 2024-02-19T22:04:49.776 INFO:tasks.workunit.client.1.smithi138.stdout: 1 503447 9.11 MB/sec execute 178 sec latency 16.995 ms 2024-02-19T22:04:49.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:48.458152+0000 mgr.smithi099.zfglya (mgr.14180) 450 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.1 MiB/s wr, 214 op/s 2024-02-19T22:04:49.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:48.458152+0000 mgr.smithi099.zfglya (mgr.14180) 450 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.1 MiB/s wr, 214 op/s 2024-02-19T22:04:50.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 917477 17.22 MB/sec execute 175 sec latency 55.145 ms 2024-02-19T22:04:50.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 505093 9.12 MB/sec execute 179 sec latency 7.317 ms 2024-02-19T22:04:51.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 921048 17.23 MB/sec execute 176 sec latency 27.615 ms 2024-02-19T22:04:51.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 506829 9.11 MB/sec execute 180 sec latency 18.415 ms 2024-02-19T22:04:51.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:50.458595+0000 mgr.smithi099.zfglya (mgr.14180) 451 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 188 op/s 2024-02-19T22:04:51.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:50.458595+0000 mgr.smithi099.zfglya (mgr.14180) 451 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 188 op/s 2024-02-19T22:04:52.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 924531 17.24 MB/sec execute 177 sec latency 35.323 ms 2024-02-19T22:04:52.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 508483 9.12 MB/sec execute 181 sec latency 5.167 ms 2024-02-19T22:04:53.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 928069 17.25 MB/sec execute 178 sec latency 46.165 ms 2024-02-19T22:04:53.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 510131 9.10 MB/sec execute 182 sec latency 16.981 ms 2024-02-19T22:04:53.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:52.459056+0000 mgr.smithi099.zfglya (mgr.14180) 452 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.2 MiB/s wr, 217 op/s 2024-02-19T22:04:53.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:52.459056+0000 mgr.smithi099.zfglya (mgr.14180) 452 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.2 MiB/s wr, 217 op/s 2024-02-19T22:04:54.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 931562 17.26 MB/sec execute 179 sec latency 85.277 ms 2024-02-19T22:04:54.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 511881 9.13 MB/sec execute 183 sec latency 13.484 ms 2024-02-19T22:04:55.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 931567 17.16 MB/sec execute 180 sec latency 366.894 ms 2024-02-19T22:04:55.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 513412 9.11 MB/sec execute 184 sec latency 8.384 ms 2024-02-19T22:04:55.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:54.459535+0000 mgr.smithi099.zfglya (mgr.14180) 453 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 170 op/s 2024-02-19T22:04:55.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:54.459535+0000 mgr.smithi099.zfglya (mgr.14180) 453 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 170 op/s 2024-02-19T22:04:56.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 934209 17.14 MB/sec execute 181 sec latency 325.164 ms 2024-02-19T22:04:56.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 515243 9.12 MB/sec execute 185 sec latency 11.758 ms 2024-02-19T22:04:57.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 937665 17.15 MB/sec execute 182 sec latency 27.570 ms 2024-02-19T22:04:57.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 516718 9.11 MB/sec execute 186 sec latency 7.075 ms 2024-02-19T22:04:57.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:56.460021+0000 mgr.smithi099.zfglya (mgr.14180) 454 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 216 op/s 2024-02-19T22:04:57.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:56.460021+0000 mgr.smithi099.zfglya (mgr.14180) 454 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.0 MiB/s wr, 216 op/s 2024-02-19T22:04:58.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 940933 17.16 MB/sec execute 183 sec latency 41.427 ms 2024-02-19T22:04:58.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 518498 9.11 MB/sec execute 187 sec latency 7.008 ms 2024-02-19T22:04:59.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 943940 17.14 MB/sec execute 184 sec latency 49.857 ms 2024-02-19T22:04:59.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 520085 9.12 MB/sec execute 188 sec latency 8.092 ms 2024-02-19T22:04:59.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:04:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:04:58.460424+0000 mgr.smithi099.zfglya (mgr.14180) 455 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.0 MiB/s wr, 209 op/s 2024-02-19T22:04:59.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:04:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:04:58.460424+0000 mgr.smithi099.zfglya (mgr.14180) 455 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.0 MiB/s wr, 209 op/s 2024-02-19T22:05:00.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 946997 17.14 MB/sec execute 185 sec latency 27.334 ms 2024-02-19T22:05:00.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 521977 9.12 MB/sec execute 189 sec latency 10.116 ms 2024-02-19T22:05:01.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 949645 17.13 MB/sec execute 186 sec latency 54.991 ms 2024-02-19T22:05:01.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 523377 9.10 MB/sec execute 190 sec latency 6.083 ms 2024-02-19T22:05:01.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:00.460912+0000 mgr.smithi099.zfglya (mgr.14180) 456 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.3 MiB/s wr, 178 op/s 2024-02-19T22:05:01.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:00.460912+0000 mgr.smithi099.zfglya (mgr.14180) 456 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.3 MiB/s wr, 178 op/s 2024-02-19T22:05:02.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 953120 17.13 MB/sec execute 187 sec latency 25.502 ms 2024-02-19T22:05:02.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 525236 9.11 MB/sec execute 191 sec latency 11.189 ms 2024-02-19T22:05:03.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 956670 17.15 MB/sec execute 188 sec latency 33.644 ms 2024-02-19T22:05:03.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 526716 9.10 MB/sec execute 192 sec latency 9.230 ms 2024-02-19T22:05:03.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:02.461388+0000 mgr.smithi099.zfglya (mgr.14180) 457 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.2 MiB/s wr, 223 op/s 2024-02-19T22:05:03.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:02.461388+0000 mgr.smithi099.zfglya (mgr.14180) 457 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.2 MiB/s wr, 223 op/s 2024-02-19T22:05:04.616 INFO:tasks.workunit.client.0.smithi099.stdout: 1 960098 17.15 MB/sec execute 189 sec latency 46.208 ms 2024-02-19T22:05:04.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 528363 9.09 MB/sec execute 193 sec latency 12.223 ms 2024-02-19T22:05:04.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:05:04.156028+0000 mon.smithi099 (mon.0) 755 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:05:04.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:05:04.475801+0000 mon.smithi099 (mon.0) 756 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:05:04.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:05:04.476386+0000 mon.smithi099 (mon.0) 757 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:05:04.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:05:04.480294+0000 mon.smithi099 (mon.0) 758 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:05:04.932 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:05:04.156028+0000 mon.smithi099 (mon.0) 755 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:05:04.932 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:05:04.475801+0000 mon.smithi099 (mon.0) 756 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:05:04.932 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:05:04.476386+0000 mon.smithi099 (mon.0) 757 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:05:04.932 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:05:04.480294+0000 mon.smithi099 (mon.0) 758 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:05:05.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 963641 17.16 MB/sec execute 190 sec latency 33.441 ms 2024-02-19T22:05:05.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 529964 9.10 MB/sec execute 194 sec latency 12.641 ms 2024-02-19T22:05:05.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:04.461905+0000 mgr.smithi099.zfglya (mgr.14180) 458 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.0 MiB/s wr, 181 op/s 2024-02-19T22:05:05.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:04.461905+0000 mgr.smithi099.zfglya (mgr.14180) 458 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.0 MiB/s wr, 181 op/s 2024-02-19T22:05:06.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 967065 17.17 MB/sec execute 191 sec latency 191.780 ms 2024-02-19T22:05:06.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 531668 9.09 MB/sec execute 195 sec latency 26.134 ms 2024-02-19T22:05:07.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 970601 17.18 MB/sec execute 192 sec latency 47.730 ms 2024-02-19T22:05:07.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 533287 9.11 MB/sec execute 196 sec latency 6.711 ms 2024-02-19T22:05:07.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:06.462580+0000 mgr.smithi099.zfglya (mgr.14180) 459 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 3.9 MiB/s wr, 188 op/s 2024-02-19T22:05:07.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:06.462580+0000 mgr.smithi099.zfglya (mgr.14180) 459 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 3.9 MiB/s wr, 188 op/s 2024-02-19T22:05:08.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 973227 17.17 MB/sec execute 193 sec latency 32.410 ms 2024-02-19T22:05:08.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 534852 9.09 MB/sec execute 197 sec latency 19.024 ms 2024-02-19T22:05:09.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 976386 17.17 MB/sec execute 194 sec latency 56.369 ms 2024-02-19T22:05:09.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 536641 9.11 MB/sec execute 198 sec latency 11.879 ms 2024-02-19T22:05:09.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:08.463025+0000 mgr.smithi099.zfglya (mgr.14180) 460 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.7 MiB/s wr, 178 op/s 2024-02-19T22:05:09.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:08.463025+0000 mgr.smithi099.zfglya (mgr.14180) 460 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.7 MiB/s wr, 178 op/s 2024-02-19T22:05:10.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 979435 17.15 MB/sec execute 195 sec latency 27.753 ms 2024-02-19T22:05:10.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 538053 9.09 MB/sec execute 199 sec latency 20.975 ms 2024-02-19T22:05:11.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 982905 17.16 MB/sec execute 196 sec latency 27.774 ms 2024-02-19T22:05:11.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 539920 9.11 MB/sec execute 200 sec latency 4.307 ms 2024-02-19T22:05:11.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:10.463515+0000 mgr.smithi099.zfglya (mgr.14180) 461 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 182 op/s 2024-02-19T22:05:11.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:10.463515+0000 mgr.smithi099.zfglya (mgr.14180) 461 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 182 op/s 2024-02-19T22:05:12.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 985596 17.16 MB/sec execute 197 sec latency 57.324 ms 2024-02-19T22:05:12.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 541433 9.10 MB/sec execute 201 sec latency 9.434 ms 2024-02-19T22:05:13.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 988574 17.15 MB/sec execute 198 sec latency 33.427 ms 2024-02-19T22:05:13.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 543292 9.10 MB/sec execute 202 sec latency 19.424 ms 2024-02-19T22:05:13.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:12.464041+0000 mgr.smithi099.zfglya (mgr.14180) 462 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.1 MiB/s wr, 225 op/s 2024-02-19T22:05:13.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:12.464041+0000 mgr.smithi099.zfglya (mgr.14180) 462 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.1 MiB/s wr, 225 op/s 2024-02-19T22:05:14.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 992044 17.16 MB/sec execute 199 sec latency 33.174 ms 2024-02-19T22:05:14.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 544707 9.09 MB/sec execute 203 sec latency 5.182 ms 2024-02-19T22:05:15.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 995575 17.17 MB/sec execute 200 sec latency 59.146 ms 2024-02-19T22:05:15.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 546695 9.10 MB/sec execute 204 sec latency 21.407 ms 2024-02-19T22:05:15.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:14.464510+0000 mgr.smithi099.zfglya (mgr.14180) 463 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 3.9 MiB/s wr, 172 op/s 2024-02-19T22:05:15.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:14.464510+0000 mgr.smithi099.zfglya (mgr.14180) 463 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 3.9 MiB/s wr, 172 op/s 2024-02-19T22:05:16.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 999068 17.18 MB/sec execute 201 sec latency 41.268 ms 2024-02-19T22:05:16.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 548060 9.09 MB/sec execute 205 sec latency 8.040 ms 2024-02-19T22:05:17.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1002606 17.19 MB/sec execute 202 sec latency 47.920 ms 2024-02-19T22:05:17.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 549829 9.09 MB/sec execute 206 sec latency 11.342 ms 2024-02-19T22:05:17.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:16.464956+0000 mgr.smithi099.zfglya (mgr.14180) 464 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 3.8 MiB/s wr, 183 op/s 2024-02-19T22:05:18.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:16.464956+0000 mgr.smithi099.zfglya (mgr.14180) 464 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 3.8 MiB/s wr, 183 op/s 2024-02-19T22:05:18.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1006153 17.20 MB/sec execute 203 sec latency 27.402 ms 2024-02-19T22:05:18.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 551336 9.09 MB/sec execute 207 sec latency 13.347 ms 2024-02-19T22:05:19.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1009690 17.20 MB/sec execute 204 sec latency 27.955 ms 2024-02-19T22:05:19.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 553022 9.08 MB/sec execute 208 sec latency 10.377 ms 2024-02-19T22:05:19.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:18.465609+0000 mgr.smithi099.zfglya (mgr.14180) 465 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.9 MiB/s wr, 211 op/s 2024-02-19T22:05:20.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:18.465609+0000 mgr.smithi099.zfglya (mgr.14180) 465 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.9 MiB/s wr, 211 op/s 2024-02-19T22:05:20.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1013186 17.21 MB/sec execute 205 sec latency 41.784 ms 2024-02-19T22:05:20.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 554629 9.09 MB/sec execute 209 sec latency 4.910 ms 2024-02-19T22:05:21.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1015272 17.18 MB/sec execute 206 sec latency 232.948 ms 2024-02-19T22:05:21.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 556258 9.07 MB/sec execute 210 sec latency 28.377 ms 2024-02-19T22:05:21.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:20.466095+0000 mgr.smithi099.zfglya (mgr.14180) 466 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.2 MiB/s wr, 195 op/s 2024-02-19T22:05:22.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:20.466095+0000 mgr.smithi099.zfglya (mgr.14180) 466 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.2 MiB/s wr, 195 op/s 2024-02-19T22:05:22.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1018395 17.17 MB/sec execute 207 sec latency 33.623 ms 2024-02-19T22:05:22.777 INFO:tasks.workunit.client.1.smithi138.stdout: 1 558010 9.09 MB/sec execute 211 sec latency 8.235 ms 2024-02-19T22:05:23.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1021236 17.17 MB/sec execute 208 sec latency 49.452 ms 2024-02-19T22:05:23.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 559504 9.08 MB/sec execute 212 sec latency 15.665 ms 2024-02-19T22:05:23.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:22.466548+0000 mgr.smithi099.zfglya (mgr.14180) 467 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 180 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.0 MiB/s wr, 196 op/s 2024-02-19T22:05:24.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:22.466548+0000 mgr.smithi099.zfglya (mgr.14180) 467 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 180 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.0 MiB/s wr, 196 op/s 2024-02-19T22:05:24.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1024131 17.16 MB/sec execute 209 sec latency 27.525 ms 2024-02-19T22:05:24.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 561356 9.09 MB/sec execute 213 sec latency 11.715 ms 2024-02-19T22:05:25.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1027575 17.17 MB/sec execute 210 sec latency 42.910 ms 2024-02-19T22:05:25.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 562785 9.08 MB/sec execute 214 sec latency 15.719 ms 2024-02-19T22:05:25.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:24.469098+0000 mgr.smithi099.zfglya (mgr.14180) 468 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.1 MiB/s wr, 187 op/s 2024-02-19T22:05:25.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:24.469098+0000 mgr.smithi099.zfglya (mgr.14180) 468 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.1 MiB/s wr, 187 op/s 2024-02-19T22:05:26.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1030917 17.18 MB/sec execute 211 sec latency 251.909 ms 2024-02-19T22:05:26.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 564584 9.08 MB/sec execute 215 sec latency 10.001 ms 2024-02-19T22:05:27.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1030969 17.10 MB/sec execute 212 sec latency 449.859 ms 2024-02-19T22:05:27.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 566015 9.07 MB/sec execute 216 sec latency 11.534 ms 2024-02-19T22:05:27.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:26.469554+0000 mgr.smithi099.zfglya (mgr.14180) 469 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.9 MiB/s wr, 202 op/s 2024-02-19T22:05:28.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:26.469554+0000 mgr.smithi099.zfglya (mgr.14180) 469 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.9 MiB/s wr, 202 op/s 2024-02-19T22:05:28.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1034461 17.11 MB/sec execute 213 sec latency 50.960 ms 2024-02-19T22:05:28.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 567982 9.08 MB/sec execute 217 sec latency 10.548 ms 2024-02-19T22:05:29.617 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1037115 17.09 MB/sec execute 214 sec latency 33.579 ms 2024-02-19T22:05:29.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 569296 9.07 MB/sec execute 218 sec latency 8.686 ms 2024-02-19T22:05:29.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:28.469963+0000 mgr.smithi099.zfglya (mgr.14180) 470 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 3.8 MiB/s wr, 190 op/s 2024-02-19T22:05:30.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:28.469963+0000 mgr.smithi099.zfglya (mgr.14180) 470 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 3.8 MiB/s wr, 190 op/s 2024-02-19T22:05:30.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1040515 17.10 MB/sec execute 215 sec latency 33.372 ms 2024-02-19T22:05:30.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 571060 9.07 MB/sec execute 219 sec latency 5.539 ms 2024-02-19T22:05:31.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1043640 17.10 MB/sec execute 216 sec latency 51.180 ms 2024-02-19T22:05:31.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 572611 9.07 MB/sec execute 220 sec latency 9.578 ms 2024-02-19T22:05:31.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:30.470536+0000 mgr.smithi099.zfglya (mgr.14180) 471 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.5 MiB/s wr, 208 op/s 2024-02-19T22:05:32.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:30.470536+0000 mgr.smithi099.zfglya (mgr.14180) 471 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.5 MiB/s wr, 208 op/s 2024-02-19T22:05:32.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1047183 17.10 MB/sec execute 217 sec latency 25.188 ms 2024-02-19T22:05:32.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 574323 9.06 MB/sec execute 221 sec latency 5.001 ms 2024-02-19T22:05:33.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1050444 17.10 MB/sec execute 218 sec latency 35.698 ms 2024-02-19T22:05:33.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 575946 9.07 MB/sec execute 222 sec latency 12.068 ms 2024-02-19T22:05:33.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:32.471100+0000 mgr.smithi099.zfglya (mgr.14180) 472 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 4.0 MiB/s wr, 204 op/s 2024-02-19T22:05:34.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:32.471100+0000 mgr.smithi099.zfglya (mgr.14180) 472 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 4.0 MiB/s wr, 204 op/s 2024-02-19T22:05:34.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1053855 17.10 MB/sec execute 219 sec latency 41.058 ms 2024-02-19T22:05:34.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 577636 9.06 MB/sec execute 223 sec latency 11.362 ms 2024-02-19T22:05:35.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1056945 17.11 MB/sec execute 220 sec latency 36.231 ms 2024-02-19T22:05:35.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 579362 9.08 MB/sec execute 224 sec latency 12.428 ms 2024-02-19T22:05:35.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:34.471552+0000 mgr.smithi099.zfglya (mgr.14180) 473 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 195 op/s 2024-02-19T22:05:35.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:34.471552+0000 mgr.smithi099.zfglya (mgr.14180) 473 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 195 op/s 2024-02-19T22:05:36.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1059603 17.10 MB/sec execute 221 sec latency 43.361 ms 2024-02-19T22:05:36.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 580957 9.06 MB/sec execute 225 sec latency 12.403 ms 2024-02-19T22:05:37.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1063074 17.10 MB/sec execute 222 sec latency 32.969 ms 2024-02-19T22:05:37.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 582772 9.08 MB/sec execute 226 sec latency 10.361 ms 2024-02-19T22:05:37.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:36.472160+0000 mgr.smithi099.zfglya (mgr.14180) 474 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.6 MiB/s wr, 169 op/s 2024-02-19T22:05:38.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:36.472160+0000 mgr.smithi099.zfglya (mgr.14180) 474 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.6 MiB/s wr, 169 op/s 2024-02-19T22:05:38.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1066433 17.11 MB/sec execute 223 sec latency 113.588 ms 2024-02-19T22:05:38.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 584225 9.07 MB/sec execute 227 sec latency 24.524 ms 2024-02-19T22:05:39.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1069971 17.12 MB/sec execute 224 sec latency 49.205 ms 2024-02-19T22:05:39.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 586070 9.08 MB/sec execute 228 sec latency 13.662 ms 2024-02-19T22:05:39.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:38.472528+0000 mgr.smithi099.zfglya (mgr.14180) 475 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 185 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 3.8 MiB/s wr, 190 op/s 2024-02-19T22:05:40.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:38.472528+0000 mgr.smithi099.zfglya (mgr.14180) 475 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 185 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 3.8 MiB/s wr, 190 op/s 2024-02-19T22:05:40.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1073464 17.13 MB/sec execute 225 sec latency 27.538 ms 2024-02-19T22:05:40.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 587488 9.07 MB/sec execute 229 sec latency 12.952 ms 2024-02-19T22:05:41.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1076117 17.12 MB/sec execute 226 sec latency 33.633 ms 2024-02-19T22:05:41.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 589367 9.07 MB/sec execute 230 sec latency 8.305 ms 2024-02-19T22:05:41.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:40.472985+0000 mgr.smithi099.zfglya (mgr.14180) 476 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 181 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 199 op/s 2024-02-19T22:05:42.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:40.472985+0000 mgr.smithi099.zfglya (mgr.14180) 476 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 181 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 199 op/s 2024-02-19T22:05:42.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1079309 17.12 MB/sec execute 227 sec latency 58.599 ms 2024-02-19T22:05:42.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 590715 9.06 MB/sec execute 231 sec latency 7.158 ms 2024-02-19T22:05:43.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1082349 17.10 MB/sec execute 228 sec latency 49.852 ms 2024-02-19T22:05:43.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 592549 9.07 MB/sec execute 232 sec latency 14.922 ms 2024-02-19T22:05:43.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:42.473435+0000 mgr.smithi099.zfglya (mgr.14180) 477 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 3.9 MiB/s wr, 193 op/s 2024-02-19T22:05:44.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:42.473435+0000 mgr.smithi099.zfglya (mgr.14180) 477 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 3.9 MiB/s wr, 193 op/s 2024-02-19T22:05:44.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1086186 17.13 MB/sec execute 229 sec latency 39.060 ms 2024-02-19T22:05:44.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 593972 9.06 MB/sec execute 233 sec latency 7.903 ms 2024-02-19T22:05:45.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1089339 17.12 MB/sec execute 230 sec latency 27.012 ms 2024-02-19T22:05:45.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 595655 9.05 MB/sec execute 234 sec latency 12.945 ms 2024-02-19T22:05:45.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:44.474021+0000 mgr.smithi099.zfglya (mgr.14180) 478 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.9 MiB/s wr, 175 op/s 2024-02-19T22:05:45.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:44.474021+0000 mgr.smithi099.zfglya (mgr.14180) 478 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.9 MiB/s wr, 175 op/s 2024-02-19T22:05:46.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1092404 17.12 MB/sec execute 231 sec latency 27.156 ms 2024-02-19T22:05:46.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 597283 9.06 MB/sec execute 235 sec latency 9.340 ms 2024-02-19T22:05:47.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1095692 17.13 MB/sec execute 232 sec latency 50.093 ms 2024-02-19T22:05:47.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 599040 9.05 MB/sec execute 236 sec latency 10.027 ms 2024-02-19T22:05:47.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:46.474591+0000 mgr.smithi099.zfglya (mgr.14180) 479 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.8 MiB/s wr, 186 op/s 2024-02-19T22:05:48.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:46.474591+0000 mgr.smithi099.zfglya (mgr.14180) 479 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.8 MiB/s wr, 186 op/s 2024-02-19T22:05:48.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1098590 17.12 MB/sec execute 233 sec latency 27.876 ms 2024-02-19T22:05:48.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 600673 9.07 MB/sec execute 237 sec latency 9.945 ms 2024-02-19T22:05:49.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1102030 17.13 MB/sec execute 234 sec latency 33.657 ms 2024-02-19T22:05:49.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 602291 9.05 MB/sec execute 238 sec latency 10.970 ms 2024-02-19T22:05:49.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:48.475006+0000 mgr.smithi099.zfglya (mgr.14180) 480 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 3.9 MiB/s wr, 207 op/s 2024-02-19T22:05:50.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:48.475006+0000 mgr.smithi099.zfglya (mgr.14180) 480 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 3.9 MiB/s wr, 207 op/s 2024-02-19T22:05:50.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1105501 17.13 MB/sec execute 235 sec latency 43.721 ms 2024-02-19T22:05:50.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 604062 9.07 MB/sec execute 239 sec latency 6.584 ms 2024-02-19T22:05:51.618 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1108979 17.14 MB/sec execute 236 sec latency 41.714 ms 2024-02-19T22:05:51.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 605513 9.05 MB/sec execute 240 sec latency 13.303 ms 2024-02-19T22:05:51.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:50.475589+0000 mgr.smithi099.zfglya (mgr.14180) 481 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 182 op/s 2024-02-19T22:05:52.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:50.475589+0000 mgr.smithi099.zfglya (mgr.14180) 481 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 182 op/s 2024-02-19T22:05:52.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1112517 17.15 MB/sec execute 237 sec latency 44.172 ms 2024-02-19T22:05:52.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 607329 9.07 MB/sec execute 241 sec latency 8.998 ms 2024-02-19T22:05:53.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1115118 17.14 MB/sec execute 238 sec latency 99.437 ms 2024-02-19T22:05:53.778 INFO:tasks.workunit.client.1.smithi138.stdout: 1 608754 9.06 MB/sec execute 242 sec latency 13.131 ms 2024-02-19T22:05:53.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:52.476036+0000 mgr.smithi099.zfglya (mgr.14180) 482 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-02-19T22:05:54.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:52.476036+0000 mgr.smithi099.zfglya (mgr.14180) 482 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-02-19T22:05:54.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1118521 17.14 MB/sec execute 239 sec latency 27.915 ms 2024-02-19T22:05:54.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 610641 9.06 MB/sec execute 243 sec latency 5.438 ms 2024-02-19T22:05:55.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1121293 17.12 MB/sec execute 240 sec latency 75.054 ms 2024-02-19T22:05:55.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 611964 9.05 MB/sec execute 244 sec latency 8.086 ms 2024-02-19T22:05:55.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:54.476410+0000 mgr.smithi099.zfglya (mgr.14180) 483 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.9 MiB/s wr, 172 op/s 2024-02-19T22:05:55.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:54.476410+0000 mgr.smithi099.zfglya (mgr.14180) 483 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.9 MiB/s wr, 172 op/s 2024-02-19T22:05:56.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1124309 17.12 MB/sec execute 241 sec latency 27.783 ms 2024-02-19T22:05:56.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 613792 9.05 MB/sec execute 245 sec latency 19.814 ms 2024-02-19T22:05:57.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1127454 17.13 MB/sec execute 242 sec latency 32.631 ms 2024-02-19T22:05:57.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 615191 9.05 MB/sec execute 246 sec latency 6.493 ms 2024-02-19T22:05:57.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:56.476890+0000 mgr.smithi099.zfglya (mgr.14180) 484 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.8 MiB/s wr, 181 op/s 2024-02-19T22:05:58.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:56.476890+0000 mgr.smithi099.zfglya (mgr.14180) 484 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.8 MiB/s wr, 181 op/s 2024-02-19T22:05:58.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1130316 17.12 MB/sec execute 243 sec latency 85.391 ms 2024-02-19T22:05:58.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 616849 9.04 MB/sec execute 247 sec latency 16.112 ms 2024-02-19T22:05:59.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1130390 17.05 MB/sec execute 244 sec latency 528.554 ms 2024-02-19T22:05:59.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 618452 9.05 MB/sec execute 248 sec latency 9.268 ms 2024-02-19T22:05:59.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:05:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:05:58.477334+0000 mgr.smithi099.zfglya (mgr.14180) 485 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.9 MiB/s wr, 206 op/s 2024-02-19T22:06:00.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:05:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:05:58.477334+0000 mgr.smithi099.zfglya (mgr.14180) 485 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.9 MiB/s wr, 206 op/s 2024-02-19T22:06:00.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1133852 17.06 MB/sec execute 245 sec latency 496.287 ms 2024-02-19T22:06:00.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 620069 9.04 MB/sec execute 249 sec latency 9.246 ms 2024-02-19T22:06:01.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1137398 17.07 MB/sec execute 246 sec latency 26.608 ms 2024-02-19T22:06:01.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 621825 9.05 MB/sec execute 250 sec latency 14.845 ms 2024-02-19T22:06:01.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:00.477795+0000 mgr.smithi099.zfglya (mgr.14180) 486 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 182 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 181 op/s 2024-02-19T22:06:02.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:00.477795+0000 mgr.smithi099.zfglya (mgr.14180) 486 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 182 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.2 MiB/s wr, 181 op/s 2024-02-19T22:06:02.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1140946 17.07 MB/sec execute 247 sec latency 28.099 ms 2024-02-19T22:06:02.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 623347 9.04 MB/sec execute 251 sec latency 9.807 ms 2024-02-19T22:06:03.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1144481 17.08 MB/sec execute 248 sec latency 56.152 ms 2024-02-19T22:06:03.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 625160 9.05 MB/sec execute 252 sec latency 9.501 ms 2024-02-19T22:06:03.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:02.478459+0000 mgr.smithi099.zfglya (mgr.14180) 487 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.1 MiB/s wr, 208 op/s 2024-02-19T22:06:04.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:02.478459+0000 mgr.smithi099.zfglya (mgr.14180) 487 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.1 MiB/s wr, 208 op/s 2024-02-19T22:06:04.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1147981 17.09 MB/sec execute 249 sec latency 33.437 ms 2024-02-19T22:06:04.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 626534 9.04 MB/sec execute 253 sec latency 14.202 ms 2024-02-19T22:06:04.931 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:06:04.486109+0000 mon.smithi099 (mon.0) 759 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:06:05.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:06:04.486109+0000 mon.smithi099 (mon.0) 759 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:06:05.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1151517 17.10 MB/sec execute 250 sec latency 33.194 ms 2024-02-19T22:06:05.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 628380 9.04 MB/sec execute 254 sec latency 6.916 ms 2024-02-19T22:06:05.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:04.478871+0000 mgr.smithi099.zfglya (mgr.14180) 488 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.9 MiB/s wr, 161 op/s 2024-02-19T22:06:05.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:06:04.805530+0000 mon.smithi099 (mon.0) 760 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:06:05.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:06:04.806167+0000 mon.smithi099 (mon.0) 761 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:06:05.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:06:04.806641+0000 mon.smithi099 (mon.0) 762 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:06:05.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:06:04.807107+0000 mon.smithi099 (mon.0) 763 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:06:05.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T22:06:04.807532+0000 mgr.smithi099.zfglya (mgr.14180) 489 : cephadm [INF] Adjusting osd_memory_target on smithi099 to 1176M 2024-02-19T22:06:05.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:06:04.811184+0000 mon.smithi099 (mon.0) 764 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:06:05.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:06:04.820361+0000 mon.smithi099 (mon.0) 765 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:06:05.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:06:04.821021+0000 mon.smithi099 (mon.0) 766 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:06:05.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:06:04.827494+0000 mon.smithi099 (mon.0) 767 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:06:05.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:04.478871+0000 mgr.smithi099.zfglya (mgr.14180) 488 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.9 MiB/s wr, 161 op/s 2024-02-19T22:06:05.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:06:04.805530+0000 mon.smithi099 (mon.0) 760 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:06:05.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:06:04.806167+0000 mon.smithi099 (mon.0) 761 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:06:05.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:06:04.806641+0000 mon.smithi099 (mon.0) 762 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:06:05.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:06:04.807107+0000 mon.smithi099 (mon.0) 763 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:06:05.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T22:06:04.807532+0000 mgr.smithi099.zfglya (mgr.14180) 489 : cephadm [INF] Adjusting osd_memory_target on smithi099 to 1176M 2024-02-19T22:06:05.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:06:04.811184+0000 mon.smithi099 (mon.0) 764 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:06:05.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:06:04.820361+0000 mon.smithi099 (mon.0) 765 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:06:05.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:06:04.821021+0000 mon.smithi099 (mon.0) 766 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:06:05.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:06:04.827494+0000 mon.smithi099 (mon.0) 767 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:06:06.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1154162 17.09 MB/sec execute 251 sec latency 41.765 ms 2024-02-19T22:06:06.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 629737 9.03 MB/sec execute 255 sec latency 6.525 ms 2024-02-19T22:06:07.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1157719 17.09 MB/sec execute 252 sec latency 30.213 ms 2024-02-19T22:06:07.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 631584 9.04 MB/sec execute 256 sec latency 15.119 ms 2024-02-19T22:06:07.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:06.479388+0000 mgr.smithi099.zfglya (mgr.14180) 490 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 208 op/s 2024-02-19T22:06:08.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:06.479388+0000 mgr.smithi099.zfglya (mgr.14180) 490 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 208 op/s 2024-02-19T22:06:08.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1161229 17.10 MB/sec execute 253 sec latency 57.089 ms 2024-02-19T22:06:08.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 632990 9.03 MB/sec execute 257 sec latency 12.614 ms 2024-02-19T22:06:09.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1164670 17.11 MB/sec execute 254 sec latency 66.720 ms 2024-02-19T22:06:09.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 634652 9.02 MB/sec execute 258 sec latency 19.182 ms 2024-02-19T22:06:09.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:08.479767+0000 mgr.smithi099.zfglya (mgr.14180) 491 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.9 MiB/s wr, 198 op/s 2024-02-19T22:06:10.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:08.479767+0000 mgr.smithi099.zfglya (mgr.14180) 491 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.9 MiB/s wr, 198 op/s 2024-02-19T22:06:10.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1167363 17.09 MB/sec execute 255 sec latency 174.350 ms 2024-02-19T22:06:10.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 636227 9.03 MB/sec execute 259 sec latency 11.741 ms 2024-02-19T22:06:11.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1170208 17.09 MB/sec execute 256 sec latency 58.433 ms 2024-02-19T22:06:11.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 637892 9.02 MB/sec execute 260 sec latency 13.337 ms 2024-02-19T22:06:11.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:10.480228+0000 mgr.smithi099.zfglya (mgr.14180) 492 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 203 op/s 2024-02-19T22:06:12.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:10.480228+0000 mgr.smithi099.zfglya (mgr.14180) 492 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 203 op/s 2024-02-19T22:06:12.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1173101 17.08 MB/sec execute 257 sec latency 27.824 ms 2024-02-19T22:06:12.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 639577 9.04 MB/sec execute 261 sec latency 12.338 ms 2024-02-19T22:06:13.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1176544 17.09 MB/sec execute 258 sec latency 31.159 ms 2024-02-19T22:06:13.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 641055 9.02 MB/sec execute 262 sec latency 24.040 ms 2024-02-19T22:06:13.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:12.480921+0000 mgr.smithi099.zfglya (mgr.14180) 493 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.9 MiB/s wr, 201 op/s 2024-02-19T22:06:14.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:12.480921+0000 mgr.smithi099.zfglya (mgr.14180) 493 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.9 MiB/s wr, 201 op/s 2024-02-19T22:06:14.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1180010 17.10 MB/sec execute 259 sec latency 42.918 ms 2024-02-19T22:06:14.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 642813 9.04 MB/sec execute 263 sec latency 9.824 ms 2024-02-19T22:06:15.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1183549 17.10 MB/sec execute 260 sec latency 33.666 ms 2024-02-19T22:06:15.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 644225 9.03 MB/sec execute 264 sec latency 14.654 ms 2024-02-19T22:06:15.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:14.481314+0000 mgr.smithi099.zfglya (mgr.14180) 494 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.8 MiB/s wr, 161 op/s 2024-02-19T22:06:15.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:14.481314+0000 mgr.smithi099.zfglya (mgr.14180) 494 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.8 MiB/s wr, 161 op/s 2024-02-19T22:06:16.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1187030 17.11 MB/sec execute 261 sec latency 43.089 ms 2024-02-19T22:06:16.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 646091 9.03 MB/sec execute 265 sec latency 5.295 ms 2024-02-19T22:06:17.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1190528 17.12 MB/sec execute 262 sec latency 32.042 ms 2024-02-19T22:06:17.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 647359 9.02 MB/sec execute 266 sec latency 11.681 ms 2024-02-19T22:06:17.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:16.481791+0000 mgr.smithi099.zfglya (mgr.14180) 495 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 196 op/s 2024-02-19T22:06:18.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:16.481791+0000 mgr.smithi099.zfglya (mgr.14180) 495 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.7 MiB/s wr, 196 op/s 2024-02-19T22:06:18.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1194058 17.13 MB/sec execute 263 sec latency 41.685 ms 2024-02-19T22:06:18.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 649096 9.02 MB/sec execute 267 sec latency 17.840 ms 2024-02-19T22:06:19.619 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1196576 17.11 MB/sec execute 264 sec latency 57.356 ms 2024-02-19T22:06:19.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 650556 9.02 MB/sec execute 268 sec latency 13.586 ms 2024-02-19T22:06:19.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:18.482251+0000 mgr.smithi099.zfglya (mgr.14180) 496 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.6 MiB/s wr, 176 op/s 2024-02-19T22:06:20.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:18.482251+0000 mgr.smithi099.zfglya (mgr.14180) 496 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.6 MiB/s wr, 176 op/s 2024-02-19T22:06:20.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1199849 17.11 MB/sec execute 265 sec latency 27.991 ms 2024-02-19T22:06:20.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 652227 9.01 MB/sec execute 269 sec latency 12.582 ms 2024-02-19T22:06:21.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1202851 17.10 MB/sec execute 266 sec latency 27.740 ms 2024-02-19T22:06:21.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 653819 9.02 MB/sec execute 270 sec latency 27.669 ms 2024-02-19T22:06:21.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:20.482801+0000 mgr.smithi099.zfglya (mgr.14180) 497 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 185 op/s 2024-02-19T22:06:22.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:20.482801+0000 mgr.smithi099.zfglya (mgr.14180) 497 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 185 op/s 2024-02-19T22:06:22.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1205810 17.10 MB/sec execute 267 sec latency 50.145 ms 2024-02-19T22:06:22.779 INFO:tasks.workunit.client.1.smithi138.stdout: 1 655358 9.01 MB/sec execute 271 sec latency 13.652 ms 2024-02-19T22:06:23.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1208556 17.09 MB/sec execute 268 sec latency 27.714 ms 2024-02-19T22:06:23.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 657198 9.02 MB/sec execute 272 sec latency 10.689 ms 2024-02-19T22:06:23.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:22.483253+0000 mgr.smithi099.zfglya (mgr.14180) 498 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.4 KiB/s rd, 3.8 MiB/s wr, 179 op/s 2024-02-19T22:06:24.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:22.483253+0000 mgr.smithi099.zfglya (mgr.14180) 498 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.4 KiB/s rd, 3.8 MiB/s wr, 179 op/s 2024-02-19T22:06:24.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1212036 17.10 MB/sec execute 269 sec latency 27.334 ms 2024-02-19T22:06:24.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 658580 9.01 MB/sec execute 273 sec latency 15.526 ms 2024-02-19T22:06:25.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1215469 17.11 MB/sec execute 270 sec latency 44.173 ms 2024-02-19T22:06:25.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 660332 9.01 MB/sec execute 274 sec latency 8.745 ms 2024-02-19T22:06:25.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:24.483687+0000 mgr.smithi099.zfglya (mgr.14180) 499 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 193 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 191 op/s 2024-02-19T22:06:25.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:24.483687+0000 mgr.smithi099.zfglya (mgr.14180) 499 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 193 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 191 op/s 2024-02-19T22:06:26.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1218948 17.11 MB/sec execute 271 sec latency 76.934 ms 2024-02-19T22:06:26.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 661769 9.00 MB/sec execute 275 sec latency 17.196 ms 2024-02-19T22:06:27.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1222432 17.12 MB/sec execute 272 sec latency 51.452 ms 2024-02-19T22:06:27.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 663726 9.01 MB/sec execute 276 sec latency 13.805 ms 2024-02-19T22:06:27.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:26.484161+0000 mgr.smithi099.zfglya (mgr.14180) 500 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 193 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 KiB/s rd, 3.9 MiB/s wr, 202 op/s 2024-02-19T22:06:28.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:26.484161+0000 mgr.smithi099.zfglya (mgr.14180) 500 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 193 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 KiB/s rd, 3.9 MiB/s wr, 202 op/s 2024-02-19T22:06:28.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1225055 17.11 MB/sec execute 273 sec latency 33.681 ms 2024-02-19T22:06:28.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 665116 9.01 MB/sec execute 277 sec latency 10.751 ms 2024-02-19T22:06:29.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1228299 17.11 MB/sec execute 274 sec latency 27.178 ms 2024-02-19T22:06:29.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 666949 9.01 MB/sec execute 278 sec latency 15.167 ms 2024-02-19T22:06:29.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:28.484539+0000 mgr.smithi099.zfglya (mgr.14180) 501 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.6 MiB/s wr, 168 op/s 2024-02-19T22:06:30.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:28.484539+0000 mgr.smithi099.zfglya (mgr.14180) 501 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.6 MiB/s wr, 168 op/s 2024-02-19T22:06:30.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1231190 17.10 MB/sec execute 275 sec latency 58.420 ms 2024-02-19T22:06:30.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 668414 9.00 MB/sec execute 279 sec latency 5.448 ms 2024-02-19T22:06:31.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1232138 17.06 MB/sec execute 276 sec latency 499.851 ms 2024-02-19T22:06:31.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 670077 9.00 MB/sec execute 280 sec latency 24.464 ms 2024-02-19T22:06:31.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:30.485007+0000 mgr.smithi099.zfglya (mgr.14180) 502 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.2 MiB/s wr, 180 op/s 2024-02-19T22:06:32.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:30.485007+0000 mgr.smithi099.zfglya (mgr.14180) 502 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.2 MiB/s wr, 180 op/s 2024-02-19T22:06:32.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1233880 17.04 MB/sec execute 277 sec latency 349.586 ms 2024-02-19T22:06:32.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 671673 9.01 MB/sec execute 281 sec latency 9.520 ms 2024-02-19T22:06:33.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1236858 17.03 MB/sec execute 278 sec latency 43.968 ms 2024-02-19T22:06:33.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 673394 9.00 MB/sec execute 282 sec latency 13.940 ms 2024-02-19T22:06:33.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:32.485508+0000 mgr.smithi099.zfglya (mgr.14180) 503 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 4.2 MiB/s wr, 219 op/s 2024-02-19T22:06:34.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:32.485508+0000 mgr.smithi099.zfglya (mgr.14180) 503 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 4.2 MiB/s wr, 219 op/s 2024-02-19T22:06:34.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1240290 17.04 MB/sec execute 279 sec latency 33.243 ms 2024-02-19T22:06:34.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 675109 9.01 MB/sec execute 283 sec latency 13.755 ms 2024-02-19T22:06:35.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1243770 17.04 MB/sec execute 280 sec latency 50.046 ms 2024-02-19T22:06:35.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 676674 9.00 MB/sec execute 284 sec latency 19.273 ms 2024-02-19T22:06:35.790 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:34.485948+0000 mgr.smithi099.zfglya (mgr.14180) 504 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 185 op/s 2024-02-19T22:06:35.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:34.485948+0000 mgr.smithi099.zfglya (mgr.14180) 504 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 185 op/s 2024-02-19T22:06:36.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1247306 17.05 MB/sec execute 281 sec latency 41.737 ms 2024-02-19T22:06:36.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 678537 9.01 MB/sec execute 285 sec latency 9.099 ms 2024-02-19T22:06:37.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1250795 17.06 MB/sec execute 282 sec latency 44.214 ms 2024-02-19T22:06:37.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 679959 9.00 MB/sec execute 286 sec latency 17.279 ms 2024-02-19T22:06:37.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:36.486425+0000 mgr.smithi099.zfglya (mgr.14180) 505 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.6 MiB/s wr, 171 op/s 2024-02-19T22:06:38.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:36.486425+0000 mgr.smithi099.zfglya (mgr.14180) 505 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.6 MiB/s wr, 171 op/s 2024-02-19T22:06:38.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1253418 17.05 MB/sec execute 283 sec latency 50.020 ms 2024-02-19T22:06:38.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 681818 9.01 MB/sec execute 287 sec latency 14.000 ms 2024-02-19T22:06:39.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1256644 17.05 MB/sec execute 284 sec latency 27.088 ms 2024-02-19T22:06:39.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 683277 9.00 MB/sec execute 288 sec latency 12.201 ms 2024-02-19T22:06:39.948 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:38.486855+0000 mgr.smithi099.zfglya (mgr.14180) 506 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.8 MiB/s wr, 199 op/s 2024-02-19T22:06:40.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:38.486855+0000 mgr.smithi099.zfglya (mgr.14180) 506 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.8 MiB/s wr, 199 op/s 2024-02-19T22:06:40.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1259584 17.03 MB/sec execute 285 sec latency 41.685 ms 2024-02-19T22:06:40.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 685159 9.01 MB/sec execute 289 sec latency 14.494 ms 2024-02-19T22:06:41.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1262395 17.04 MB/sec execute 286 sec latency 52.317 ms 2024-02-19T22:06:41.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 686525 9.00 MB/sec execute 290 sec latency 9.203 ms 2024-02-19T22:06:41.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:40.487362+0000 mgr.smithi099.zfglya (mgr.14180) 507 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.5 MiB/s wr, 209 op/s 2024-02-19T22:06:42.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:40.487362+0000 mgr.smithi099.zfglya (mgr.14180) 507 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.5 MiB/s wr, 209 op/s 2024-02-19T22:06:42.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1265182 17.03 MB/sec execute 287 sec latency 96.586 ms 2024-02-19T22:06:42.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 688369 9.00 MB/sec execute 291 sec latency 17.728 ms 2024-02-19T22:06:43.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1268648 17.03 MB/sec execute 288 sec latency 50.097 ms 2024-02-19T22:06:43.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 689822 9.00 MB/sec execute 292 sec latency 15.151 ms 2024-02-19T22:06:43.949 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:42.487834+0000 mgr.smithi099.zfglya (mgr.14180) 508 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 4.1 MiB/s wr, 221 op/s 2024-02-19T22:06:44.040 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:42.487834+0000 mgr.smithi099.zfglya (mgr.14180) 508 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 4.1 MiB/s wr, 221 op/s 2024-02-19T22:06:44.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1272130 17.04 MB/sec execute 289 sec latency 27.145 ms 2024-02-19T22:06:44.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 691502 8.99 MB/sec execute 293 sec latency 14.339 ms 2024-02-19T22:06:45.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1275670 17.05 MB/sec execute 290 sec latency 41.141 ms 2024-02-19T22:06:45.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 693105 9.00 MB/sec execute 294 sec latency 14.122 ms 2024-02-19T22:06:46.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:44.488292+0000 mgr.smithi099.zfglya (mgr.14180) 509 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 174 op/s 2024-02-19T22:06:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:44.488292+0000 mgr.smithi099.zfglya (mgr.14180) 509 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 174 op/s 2024-02-19T22:06:46.620 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1279158 17.05 MB/sec execute 291 sec latency 43.362 ms 2024-02-19T22:06:46.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 694814 8.99 MB/sec execute 295 sec latency 10.101 ms 2024-02-19T22:06:47.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1281782 17.04 MB/sec execute 292 sec latency 33.665 ms 2024-02-19T22:06:47.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 696425 9.00 MB/sec execute 296 sec latency 7.331 ms 2024-02-19T22:06:48.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:46.488739+0000 mgr.smithi099.zfglya (mgr.14180) 510 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 182 op/s 2024-02-19T22:06:48.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:46.488739+0000 mgr.smithi099.zfglya (mgr.14180) 510 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 182 op/s 2024-02-19T22:06:48.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1285025 17.05 MB/sec execute 293 sec latency 27.249 ms 2024-02-19T22:06:48.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 697932 8.99 MB/sec execute 297 sec latency 21.583 ms 2024-02-19T22:06:49.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1287950 17.03 MB/sec execute 294 sec latency 50.527 ms 2024-02-19T22:06:49.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 699712 9.00 MB/sec execute 298 sec latency 9.383 ms 2024-02-19T22:06:50.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:48.489196+0000 mgr.smithi099.zfglya (mgr.14180) 511 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.0 MiB/s wr, 212 op/s 2024-02-19T22:06:50.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:48.489196+0000 mgr.smithi099.zfglya (mgr.14180) 511 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.0 MiB/s wr, 212 op/s 2024-02-19T22:06:50.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1291009 17.04 MB/sec execute 295 sec latency 33.529 ms 2024-02-19T22:06:50.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 701080 8.99 MB/sec execute 299 sec latency 10.277 ms 2024-02-19T22:06:51.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1293655 17.03 MB/sec execute 296 sec latency 50.097 ms 2024-02-19T22:06:51.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 702891 8.99 MB/sec execute 300 sec latency 5.680 ms 2024-02-19T22:06:52.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:50.489711+0000 mgr.smithi099.zfglya (mgr.14180) 512 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 183 op/s 2024-02-19T22:06:52.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:50.489711+0000 mgr.smithi099.zfglya (mgr.14180) 512 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 4.2 MiB/s wr, 183 op/s 2024-02-19T22:06:52.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1297137 17.03 MB/sec execute 297 sec latency 33.644 ms 2024-02-19T22:06:52.780 INFO:tasks.workunit.client.1.smithi138.stdout: 1 704202 8.99 MB/sec execute 301 sec latency 5.890 ms 2024-02-19T22:06:53.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1300602 17.04 MB/sec execute 298 sec latency 31.215 ms 2024-02-19T22:06:53.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 706009 8.99 MB/sec execute 302 sec latency 4.986 ms 2024-02-19T22:06:54.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:52.490201+0000 mgr.smithi099.zfglya (mgr.14180) 513 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 193 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 4.0 MiB/s wr, 218 op/s 2024-02-19T22:06:54.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:52.490201+0000 mgr.smithi099.zfglya (mgr.14180) 513 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 193 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 4.0 MiB/s wr, 218 op/s 2024-02-19T22:06:54.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1304109 17.05 MB/sec execute 299 sec latency 43.744 ms 2024-02-19T22:06:54.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 707384 8.98 MB/sec execute 303 sec latency 5.867 ms 2024-02-19T22:06:55.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1307645 17.05 MB/sec execute 300 sec latency 27.756 ms 2024-02-19T22:06:55.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 709038 8.98 MB/sec execute 304 sec latency 13.036 ms 2024-02-19T22:06:56.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:54.490593+0000 mgr.smithi099.zfglya (mgr.14180) 514 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 165 op/s 2024-02-19T22:06:56.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:54.490593+0000 mgr.smithi099.zfglya (mgr.14180) 514 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 165 op/s 2024-02-19T22:06:56.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1311140 17.06 MB/sec execute 301 sec latency 26.446 ms 2024-02-19T22:06:56.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 710650 8.99 MB/sec execute 305 sec latency 6.550 ms 2024-02-19T22:06:57.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1313749 17.05 MB/sec execute 302 sec latency 91.011 ms 2024-02-19T22:06:57.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 712240 8.98 MB/sec execute 306 sec latency 13.680 ms 2024-02-19T22:06:58.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:56.491116+0000 mgr.smithi099.zfglya (mgr.14180) 515 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 174 op/s 2024-02-19T22:06:58.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:56.491116+0000 mgr.smithi099.zfglya (mgr.14180) 515 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 174 op/s 2024-02-19T22:06:58.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1316917 17.05 MB/sec execute 303 sec latency 33.826 ms 2024-02-19T22:06:58.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 714009 8.99 MB/sec execute 307 sec latency 14.762 ms 2024-02-19T22:06:59.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1319924 17.04 MB/sec execute 304 sec latency 27.646 ms 2024-02-19T22:06:59.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 715422 8.98 MB/sec execute 308 sec latency 12.671 ms 2024-02-19T22:07:00.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:06:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:06:58.491565+0000 mgr.smithi099.zfglya (mgr.14180) 516 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.9 MiB/s wr, 202 op/s 2024-02-19T22:07:00.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:06:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:06:58.491565+0000 mgr.smithi099.zfglya (mgr.14180) 516 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.9 MiB/s wr, 202 op/s 2024-02-19T22:07:00.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1322978 17.04 MB/sec execute 305 sec latency 49.859 ms 2024-02-19T22:07:00.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 717160 8.98 MB/sec execute 309 sec latency 13.773 ms 2024-02-19T22:07:01.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1326275 17.05 MB/sec execute 306 sec latency 28.043 ms 2024-02-19T22:07:01.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 718599 8.97 MB/sec execute 310 sec latency 15.255 ms 2024-02-19T22:07:02.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:00.492047+0000 mgr.smithi099.zfglya (mgr.14180) 517 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 176 op/s 2024-02-19T22:07:02.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:00.492047+0000 mgr.smithi099.zfglya (mgr.14180) 517 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 176 op/s 2024-02-19T22:07:02.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1329667 17.05 MB/sec execute 307 sec latency 77.244 ms 2024-02-19T22:07:02.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 720585 8.98 MB/sec execute 311 sec latency 4.886 ms 2024-02-19T22:07:03.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1330070 17.00 MB/sec execute 308 sec latency 394.658 ms 2024-02-19T22:07:03.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 721808 8.97 MB/sec execute 312 sec latency 10.042 ms 2024-02-19T22:07:04.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:02.492488+0000 mgr.smithi099.zfglya (mgr.14180) 518 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.0 MiB/s wr, 215 op/s 2024-02-19T22:07:04.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:02.492488+0000 mgr.smithi099.zfglya (mgr.14180) 518 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 4.0 MiB/s wr, 215 op/s 2024-02-19T22:07:04.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1332655 16.99 MB/sec execute 309 sec latency 74.011 ms 2024-02-19T22:07:04.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 723456 8.97 MB/sec execute 313 sec latency 16.874 ms 2024-02-19T22:07:05.199 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:07:04.832933+0000 mon.smithi099 (mon.0) 768 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:07:05.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:07:04.832933+0000 mon.smithi099 (mon.0) 768 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:07:05.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1336081 17.00 MB/sec execute 310 sec latency 49.828 ms 2024-02-19T22:07:05.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 724943 8.97 MB/sec execute 314 sec latency 17.319 ms 2024-02-19T22:07:06.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:04.492871+0000 mgr.smithi099.zfglya (mgr.14180) 519 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.8 MiB/s wr, 169 op/s 2024-02-19T22:07:06.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:07:05.153739+0000 mon.smithi099 (mon.0) 769 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:07:06.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:07:05.154427+0000 mon.smithi099 (mon.0) 770 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:07:06.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:07:05.158695+0000 mon.smithi099 (mon.0) 771 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:07:06.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:04.492871+0000 mgr.smithi099.zfglya (mgr.14180) 519 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.8 MiB/s wr, 169 op/s 2024-02-19T22:07:06.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:07:05.153739+0000 mon.smithi099 (mon.0) 769 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:07:06.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:07:05.154427+0000 mon.smithi099 (mon.0) 770 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:07:06.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:07:05.158695+0000 mon.smithi099 (mon.0) 771 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:07:06.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1339620 17.00 MB/sec execute 311 sec latency 58.257 ms 2024-02-19T22:07:06.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 726582 8.96 MB/sec execute 315 sec latency 11.472 ms 2024-02-19T22:07:07.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1343103 17.01 MB/sec execute 312 sec latency 27.991 ms 2024-02-19T22:07:07.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 728266 8.98 MB/sec execute 316 sec latency 12.591 ms 2024-02-19T22:07:08.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:06.493328+0000 mgr.smithi099.zfglya (mgr.14180) 520 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.9 MiB/s wr, 195 op/s 2024-02-19T22:07:08.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:06.493328+0000 mgr.smithi099.zfglya (mgr.14180) 520 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.9 MiB/s wr, 195 op/s 2024-02-19T22:07:08.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1346643 17.02 MB/sec execute 313 sec latency 54.436 ms 2024-02-19T22:07:08.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 729706 8.97 MB/sec execute 317 sec latency 11.271 ms 2024-02-19T22:07:09.621 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1350139 17.02 MB/sec execute 314 sec latency 34.895 ms 2024-02-19T22:07:09.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 731484 8.98 MB/sec execute 318 sec latency 6.105 ms 2024-02-19T22:07:10.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:08.493753+0000 mgr.smithi099.zfglya (mgr.14180) 521 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.9 MiB/s wr, 192 op/s 2024-02-19T22:07:10.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:08.493753+0000 mgr.smithi099.zfglya (mgr.14180) 521 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.9 MiB/s wr, 192 op/s 2024-02-19T22:07:10.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1353297 17.03 MB/sec execute 315 sec latency 49.544 ms 2024-02-19T22:07:10.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 732879 8.97 MB/sec execute 319 sec latency 10.964 ms 2024-02-19T22:07:11.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1356295 17.02 MB/sec execute 316 sec latency 26.803 ms 2024-02-19T22:07:11.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 734777 8.97 MB/sec execute 320 sec latency 6.986 ms 2024-02-19T22:07:12.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:10.494207+0000 mgr.smithi099.zfglya (mgr.14180) 522 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.2 MiB/s wr, 202 op/s 2024-02-19T22:07:12.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:10.494207+0000 mgr.smithi099.zfglya (mgr.14180) 522 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.2 MiB/s wr, 202 op/s 2024-02-19T22:07:12.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1359463 17.02 MB/sec execute 317 sec latency 41.522 ms 2024-02-19T22:07:12.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 736032 8.96 MB/sec execute 321 sec latency 11.963 ms 2024-02-19T22:07:13.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1362439 17.01 MB/sec execute 318 sec latency 55.409 ms 2024-02-19T22:07:13.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 737755 8.96 MB/sec execute 322 sec latency 18.601 ms 2024-02-19T22:07:14.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:12.494672+0000 mgr.smithi099.zfglya (mgr.14180) 523 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 4.1 MiB/s wr, 206 op/s 2024-02-19T22:07:14.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:12.494672+0000 mgr.smithi099.zfglya (mgr.14180) 523 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 4.1 MiB/s wr, 206 op/s 2024-02-19T22:07:14.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1364521 17.00 MB/sec execute 319 sec latency 110.139 ms 2024-02-19T22:07:14.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 739253 8.96 MB/sec execute 323 sec latency 13.623 ms 2024-02-19T22:07:15.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1367990 17.00 MB/sec execute 320 sec latency 33.436 ms 2024-02-19T22:07:15.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 740945 8.95 MB/sec execute 324 sec latency 9.196 ms 2024-02-19T22:07:16.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:14.495058+0000 mgr.smithi099.zfglya (mgr.14180) 524 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 3.7 MiB/s wr, 157 op/s 2024-02-19T22:07:16.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:14.495058+0000 mgr.smithi099.zfglya (mgr.14180) 524 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 3.7 MiB/s wr, 157 op/s 2024-02-19T22:07:16.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1371467 17.01 MB/sec execute 321 sec latency 58.428 ms 2024-02-19T22:07:16.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 742529 8.96 MB/sec execute 325 sec latency 5.599 ms 2024-02-19T22:07:17.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1375698 17.08 MB/sec execute 322 sec latency 25.933 ms 2024-02-19T22:07:17.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 744116 8.95 MB/sec execute 326 sec latency 19.738 ms 2024-02-19T22:07:18.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:16.495628+0000 mgr.smithi099.zfglya (mgr.14180) 525 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-02-19T22:07:18.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:16.495628+0000 mgr.smithi099.zfglya (mgr.14180) 525 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-02-19T22:07:18.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1378337 17.07 MB/sec execute 323 sec latency 49.036 ms 2024-02-19T22:07:18.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 745931 8.97 MB/sec execute 327 sec latency 9.177 ms 2024-02-19T22:07:19.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1381569 17.07 MB/sec execute 324 sec latency 27.125 ms 2024-02-19T22:07:19.781 INFO:tasks.workunit.client.1.smithi138.stdout: 1 747389 8.96 MB/sec execute 328 sec latency 10.700 ms 2024-02-19T22:07:20.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:18.496050+0000 mgr.smithi099.zfglya (mgr.14180) 526 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.6 MiB/s wr, 177 op/s 2024-02-19T22:07:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:18.496050+0000 mgr.smithi099.zfglya (mgr.14180) 526 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.6 MiB/s wr, 177 op/s 2024-02-19T22:07:20.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1384552 17.06 MB/sec execute 325 sec latency 32.992 ms 2024-02-19T22:07:20.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 749229 8.97 MB/sec execute 329 sec latency 7.622 ms 2024-02-19T22:07:21.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1387574 17.06 MB/sec execute 326 sec latency 50.051 ms 2024-02-19T22:07:21.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 750688 8.96 MB/sec execute 330 sec latency 25.229 ms 2024-02-19T22:07:22.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:20.496587+0000 mgr.smithi099.zfglya (mgr.14180) 527 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 4.1 MiB/s wr, 184 op/s 2024-02-19T22:07:22.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:20.496587+0000 mgr.smithi099.zfglya (mgr.14180) 527 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 4.1 MiB/s wr, 184 op/s 2024-02-19T22:07:22.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1390220 17.06 MB/sec execute 327 sec latency 28.198 ms 2024-02-19T22:07:22.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 752536 8.96 MB/sec execute 331 sec latency 13.456 ms 2024-02-19T22:07:23.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1393768 17.06 MB/sec execute 328 sec latency 25.303 ms 2024-02-19T22:07:23.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 753974 8.95 MB/sec execute 332 sec latency 9.365 ms 2024-02-19T22:07:24.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:22.497082+0000 mgr.smithi099.zfglya (mgr.14180) 528 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.8 MiB/s wr, 182 op/s 2024-02-19T22:07:24.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:22.497082+0000 mgr.smithi099.zfglya (mgr.14180) 528 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.8 MiB/s wr, 182 op/s 2024-02-19T22:07:24.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1397844 17.08 MB/sec execute 329 sec latency 39.528 ms 2024-02-19T22:07:24.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 755940 8.96 MB/sec execute 333 sec latency 10.212 ms 2024-02-19T22:07:25.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1400896 17.08 MB/sec execute 330 sec latency 31.161 ms 2024-02-19T22:07:25.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 757254 8.95 MB/sec execute 334 sec latency 11.009 ms 2024-02-19T22:07:26.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:24.497570+0000 mgr.smithi099.zfglya (mgr.14180) 529 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.8 MiB/s wr, 164 op/s 2024-02-19T22:07:26.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:24.497570+0000 mgr.smithi099.zfglya (mgr.14180) 529 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.8 MiB/s wr, 164 op/s 2024-02-19T22:07:26.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1404332 17.08 MB/sec execute 331 sec latency 51.912 ms 2024-02-19T22:07:26.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 758926 8.95 MB/sec execute 335 sec latency 13.313 ms 2024-02-19T22:07:27.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1407883 17.09 MB/sec execute 332 sec latency 33.612 ms 2024-02-19T22:07:27.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 760534 8.96 MB/sec execute 336 sec latency 6.549 ms 2024-02-19T22:07:28.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:26.498044+0000 mgr.smithi099.zfglya (mgr.14180) 530 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.8 MiB/s wr, 202 op/s 2024-02-19T22:07:28.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:26.498044+0000 mgr.smithi099.zfglya (mgr.14180) 530 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.8 MiB/s wr, 202 op/s 2024-02-19T22:07:28.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1411426 17.09 MB/sec execute 333 sec latency 32.793 ms 2024-02-19T22:07:28.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 762232 8.95 MB/sec execute 337 sec latency 23.572 ms 2024-02-19T22:07:29.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1414900 17.10 MB/sec execute 334 sec latency 42.596 ms 2024-02-19T22:07:29.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 763844 8.96 MB/sec execute 338 sec latency 13.670 ms 2024-02-19T22:07:30.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:28.498503+0000 mgr.smithi099.zfglya (mgr.14180) 531 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.5 MiB/s wr, 179 op/s 2024-02-19T22:07:30.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:28.498503+0000 mgr.smithi099.zfglya (mgr.14180) 531 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 3.5 MiB/s wr, 179 op/s 2024-02-19T22:07:30.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1418435 17.10 MB/sec execute 335 sec latency 33.127 ms 2024-02-19T22:07:30.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 765413 8.95 MB/sec execute 339 sec latency 26.133 ms 2024-02-19T22:07:31.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1421924 17.11 MB/sec execute 336 sec latency 27.758 ms 2024-02-19T22:07:31.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 767180 8.96 MB/sec execute 340 sec latency 9.240 ms 2024-02-19T22:07:32.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:30.499004+0000 mgr.smithi099.zfglya (mgr.14180) 532 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 191 op/s 2024-02-19T22:07:32.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:30.499004+0000 mgr.smithi099.zfglya (mgr.14180) 532 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.3 MiB/s wr, 191 op/s 2024-02-19T22:07:32.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1425409 17.12 MB/sec execute 337 sec latency 95.168 ms 2024-02-19T22:07:32.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 768573 8.95 MB/sec execute 341 sec latency 9.895 ms 2024-02-19T22:07:33.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1428952 17.12 MB/sec execute 338 sec latency 27.550 ms 2024-02-19T22:07:33.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 770290 8.95 MB/sec execute 342 sec latency 5.373 ms 2024-02-19T22:07:34.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:32.499462+0000 mgr.smithi099.zfglya (mgr.14180) 533 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.1 MiB/s wr, 228 op/s 2024-02-19T22:07:34.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:32.499462+0000 mgr.smithi099.zfglya (mgr.14180) 533 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.1 KiB/s rd, 4.1 MiB/s wr, 228 op/s 2024-02-19T22:07:34.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1430615 17.09 MB/sec execute 339 sec latency 237.153 ms 2024-02-19T22:07:34.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 771678 8.95 MB/sec execute 343 sec latency 13.789 ms 2024-02-19T22:07:35.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1431267 17.06 MB/sec execute 340 sec latency 377.329 ms 2024-02-19T22:07:35.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 773466 8.95 MB/sec execute 344 sec latency 21.248 ms 2024-02-19T22:07:36.290 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:34.499888+0000 mgr.smithi099.zfglya (mgr.14180) 534 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 181 op/s 2024-02-19T22:07:36.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:34.499888+0000 mgr.smithi099.zfglya (mgr.14180) 534 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 181 op/s 2024-02-19T22:07:36.622 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1435105 17.07 MB/sec execute 341 sec latency 25.385 ms 2024-02-19T22:07:36.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 774856 8.94 MB/sec execute 345 sec latency 15.737 ms 2024-02-19T22:07:37.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1438358 17.07 MB/sec execute 342 sec latency 58.558 ms 2024-02-19T22:07:37.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 776490 8.94 MB/sec execute 346 sec latency 24.199 ms 2024-02-19T22:07:38.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:36.500370+0000 mgr.smithi099.zfglya (mgr.14180) 535 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.8 MiB/s wr, 193 op/s 2024-02-19T22:07:38.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:36.500370+0000 mgr.smithi099.zfglya (mgr.14180) 535 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.8 MiB/s wr, 193 op/s 2024-02-19T22:07:38.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1441669 17.07 MB/sec execute 343 sec latency 41.740 ms 2024-02-19T22:07:38.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 778059 8.95 MB/sec execute 347 sec latency 9.012 ms 2024-02-19T22:07:39.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1444824 17.07 MB/sec execute 344 sec latency 27.346 ms 2024-02-19T22:07:39.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 779652 8.94 MB/sec execute 348 sec latency 15.828 ms 2024-02-19T22:07:40.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:38.500795+0000 mgr.smithi099.zfglya (mgr.14180) 536 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 4.0 MiB/s wr, 194 op/s 2024-02-19T22:07:40.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:38.500795+0000 mgr.smithi099.zfglya (mgr.14180) 536 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 4.0 MiB/s wr, 194 op/s 2024-02-19T22:07:40.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1447635 17.07 MB/sec execute 345 sec latency 58.431 ms 2024-02-19T22:07:40.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 781378 8.95 MB/sec execute 349 sec latency 7.260 ms 2024-02-19T22:07:41.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1450565 17.06 MB/sec execute 346 sec latency 32.932 ms 2024-02-19T22:07:41.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 782734 8.94 MB/sec execute 350 sec latency 14.070 ms 2024-02-19T22:07:42.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:40.501296+0000 mgr.smithi099.zfglya (mgr.14180) 537 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 180 op/s 2024-02-19T22:07:42.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:40.501296+0000 mgr.smithi099.zfglya (mgr.14180) 537 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 180 op/s 2024-02-19T22:07:42.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1454002 17.07 MB/sec execute 347 sec latency 33.385 ms 2024-02-19T22:07:42.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 784470 8.94 MB/sec execute 351 sec latency 13.138 ms 2024-02-19T22:07:43.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1457470 17.07 MB/sec execute 348 sec latency 48.788 ms 2024-02-19T22:07:43.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 785805 8.93 MB/sec execute 352 sec latency 18.804 ms 2024-02-19T22:07:44.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:42.501794+0000 mgr.smithi099.zfglya (mgr.14180) 538 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.8 MiB/s wr, 207 op/s 2024-02-19T22:07:44.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:42.501794+0000 mgr.smithi099.zfglya (mgr.14180) 538 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.8 MiB/s wr, 207 op/s 2024-02-19T22:07:44.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1461011 17.08 MB/sec execute 349 sec latency 25.366 ms 2024-02-19T22:07:44.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 787581 8.94 MB/sec execute 353 sec latency 8.174 ms 2024-02-19T22:07:45.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1464502 17.08 MB/sec execute 350 sec latency 49.766 ms 2024-02-19T22:07:45.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 788971 8.93 MB/sec execute 354 sec latency 10.402 ms 2024-02-19T22:07:46.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:44.502299+0000 mgr.smithi099.zfglya (mgr.14180) 539 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.6 MiB/s wr, 157 op/s 2024-02-19T22:07:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:44.502299+0000 mgr.smithi099.zfglya (mgr.14180) 539 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.6 MiB/s wr, 157 op/s 2024-02-19T22:07:46.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1467985 17.09 MB/sec execute 351 sec latency 115.006 ms 2024-02-19T22:07:46.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 790659 8.93 MB/sec execute 355 sec latency 8.713 ms 2024-02-19T22:07:47.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1471525 17.09 MB/sec execute 352 sec latency 34.312 ms 2024-02-19T22:07:47.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 792262 8.94 MB/sec execute 356 sec latency 15.211 ms 2024-02-19T22:07:48.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:46.502762+0000 mgr.smithi099.zfglya (mgr.14180) 540 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-02-19T22:07:48.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:46.502762+0000 mgr.smithi099.zfglya (mgr.14180) 540 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-02-19T22:07:48.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1474104 17.08 MB/sec execute 353 sec latency 44.591 ms 2024-02-19T22:07:48.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 793925 8.93 MB/sec execute 357 sec latency 11.137 ms 2024-02-19T22:07:49.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1477158 17.08 MB/sec execute 354 sec latency 41.722 ms 2024-02-19T22:07:49.782 INFO:tasks.workunit.client.1.smithi138.stdout: 1 795636 8.94 MB/sec execute 358 sec latency 8.613 ms 2024-02-19T22:07:50.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:48.503266+0000 mgr.smithi099.zfglya (mgr.14180) 541 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.8 MiB/s wr, 203 op/s 2024-02-19T22:07:50.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:48.503266+0000 mgr.smithi099.zfglya (mgr.14180) 541 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.8 MiB/s wr, 203 op/s 2024-02-19T22:07:50.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1480289 17.08 MB/sec execute 355 sec latency 33.662 ms 2024-02-19T22:07:50.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 797134 8.93 MB/sec execute 359 sec latency 12.273 ms 2024-02-19T22:07:51.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1482292 17.06 MB/sec execute 356 sec latency 159.595 ms 2024-02-19T22:07:51.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 798942 8.94 MB/sec execute 360 sec latency 13.421 ms 2024-02-19T22:07:52.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:50.503732+0000 mgr.smithi099.zfglya (mgr.14180) 542 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.9 MiB/s wr, 172 op/s 2024-02-19T22:07:52.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:50.503732+0000 mgr.smithi099.zfglya (mgr.14180) 542 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.9 MiB/s wr, 172 op/s 2024-02-19T22:07:52.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1485835 17.07 MB/sec execute 357 sec latency 27.766 ms 2024-02-19T22:07:52.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 800324 8.93 MB/sec execute 361 sec latency 9.241 ms 2024-02-19T22:07:53.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1489313 17.07 MB/sec execute 358 sec latency 58.515 ms 2024-02-19T22:07:53.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 802175 8.93 MB/sec execute 362 sec latency 5.762 ms 2024-02-19T22:07:54.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:52.504255+0000 mgr.smithi099.zfglya (mgr.14180) 543 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.9 MiB/s wr, 213 op/s 2024-02-19T22:07:54.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:52.504255+0000 mgr.smithi099.zfglya (mgr.14180) 543 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.9 MiB/s wr, 213 op/s 2024-02-19T22:07:54.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1492810 17.08 MB/sec execute 359 sec latency 33.680 ms 2024-02-19T22:07:54.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 803575 8.93 MB/sec execute 363 sec latency 19.894 ms 2024-02-19T22:07:55.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1496349 17.08 MB/sec execute 360 sec latency 25.156 ms 2024-02-19T22:07:55.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 805427 8.93 MB/sec execute 364 sec latency 14.373 ms 2024-02-19T22:07:56.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:54.504919+0000 mgr.smithi099.zfglya (mgr.14180) 544 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.9 MiB/s wr, 173 op/s 2024-02-19T22:07:56.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:54.504919+0000 mgr.smithi099.zfglya (mgr.14180) 544 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.9 MiB/s wr, 173 op/s 2024-02-19T22:07:56.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1499898 17.09 MB/sec execute 361 sec latency 49.711 ms 2024-02-19T22:07:56.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 806886 8.93 MB/sec execute 365 sec latency 11.918 ms 2024-02-19T22:07:57.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1503442 17.10 MB/sec execute 362 sec latency 27.624 ms 2024-02-19T22:07:57.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 808571 8.92 MB/sec execute 366 sec latency 14.238 ms 2024-02-19T22:07:58.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:07:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:56.505393+0000 mgr.smithi099.zfglya (mgr.14180) 545 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.9 MiB/s wr, 186 op/s 2024-02-19T22:07:58.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:07:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:56.505393+0000 mgr.smithi099.zfglya (mgr.14180) 545 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.9 MiB/s wr, 186 op/s 2024-02-19T22:07:58.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1506987 17.10 MB/sec execute 363 sec latency 31.239 ms 2024-02-19T22:07:58.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 810194 8.93 MB/sec execute 367 sec latency 4.852 ms 2024-02-19T22:07:59.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1509602 17.09 MB/sec execute 364 sec latency 66.994 ms 2024-02-19T22:07:59.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 811866 8.92 MB/sec execute 368 sec latency 11.939 ms 2024-02-19T22:08:00.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:07:58.505815+0000 mgr.smithi099.zfglya (mgr.14180) 546 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.6 MiB/s wr, 179 op/s 2024-02-19T22:08:00.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:07:58.505815+0000 mgr.smithi099.zfglya (mgr.14180) 546 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.6 MiB/s wr, 179 op/s 2024-02-19T22:08:00.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1512771 17.09 MB/sec execute 365 sec latency 33.684 ms 2024-02-19T22:08:00.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 813431 8.93 MB/sec execute 369 sec latency 14.664 ms 2024-02-19T22:08:01.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1515746 17.08 MB/sec execute 366 sec latency 52.261 ms 2024-02-19T22:08:01.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 814912 8.92 MB/sec execute 370 sec latency 11.058 ms 2024-02-19T22:08:02.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:00.506296+0000 mgr.smithi099.zfglya (mgr.14180) 547 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.1 MiB/s wr, 181 op/s 2024-02-19T22:08:02.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:00.506296+0000 mgr.smithi099.zfglya (mgr.14180) 547 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.1 MiB/s wr, 181 op/s 2024-02-19T22:08:02.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1518583 17.09 MB/sec execute 367 sec latency 33.306 ms 2024-02-19T22:08:02.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 816697 8.93 MB/sec execute 371 sec latency 10.418 ms 2024-02-19T22:08:03.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1521481 17.08 MB/sec execute 368 sec latency 33.178 ms 2024-02-19T22:08:03.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 818057 8.92 MB/sec execute 372 sec latency 6.271 ms 2024-02-19T22:08:04.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:02.506761+0000 mgr.smithi099.zfglya (mgr.14180) 548 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.2 MiB/s wr, 219 op/s 2024-02-19T22:08:04.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:02.506761+0000 mgr.smithi099.zfglya (mgr.14180) 548 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.0 KiB/s rd, 4.2 MiB/s wr, 219 op/s 2024-02-19T22:08:04.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1524916 17.08 MB/sec execute 369 sec latency 52.885 ms 2024-02-19T22:08:04.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 819887 8.93 MB/sec execute 373 sec latency 6.819 ms 2024-02-19T22:08:05.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1528385 17.09 MB/sec execute 370 sec latency 50.009 ms 2024-02-19T22:08:05.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 821079 8.92 MB/sec execute 374 sec latency 10.540 ms 2024-02-19T22:08:06.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:04.507154+0000 mgr.smithi099.zfglya (mgr.14180) 549 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.9 MiB/s wr, 168 op/s 2024-02-19T22:08:06.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:08:05.164772+0000 mon.smithi099 (mon.0) 772 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:08:06.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:08:05.505630+0000 mon.smithi099 (mon.0) 773 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:08:06.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:08:05.506224+0000 mon.smithi099 (mon.0) 774 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:08:06.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:08:05.506801+0000 mon.smithi099 (mon.0) 775 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:08:06.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:08:05.507365+0000 mon.smithi099 (mon.0) 776 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:08:06.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:08:05.511211+0000 mon.smithi099 (mon.0) 777 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:08:06.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:08:05.511869+0000 mon.smithi099 (mon.0) 778 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:08:06.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:08:05.512440+0000 mon.smithi099 (mon.0) 779 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:08:06.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:08:05.516423+0000 mon.smithi099 (mon.0) 780 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:08:06.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:04.507154+0000 mgr.smithi099.zfglya (mgr.14180) 549 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.9 MiB/s wr, 168 op/s 2024-02-19T22:08:06.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:08:05.164772+0000 mon.smithi099 (mon.0) 772 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:08:06.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:08:05.505630+0000 mon.smithi099 (mon.0) 773 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:08:06.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:08:05.506224+0000 mon.smithi099 (mon.0) 774 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:08:06.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:08:05.506801+0000 mon.smithi099 (mon.0) 775 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:08:06.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:08:05.507365+0000 mon.smithi099 (mon.0) 776 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-19T22:08:06.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:08:05.511211+0000 mon.smithi099 (mon.0) 777 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:08:06.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:08:05.511869+0000 mon.smithi099 (mon.0) 778 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:08:06.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:08:05.512440+0000 mon.smithi099 (mon.0) 779 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:08:06.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:08:05.516423+0000 mon.smithi099 (mon.0) 780 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:08:06.623 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1531866 17.09 MB/sec execute 371 sec latency 36.513 ms 2024-02-19T22:08:06.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 822716 8.91 MB/sec execute 375 sec latency 12.686 ms 2024-02-19T22:08:07.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cephadm 2024-02-19T22:08:05.507778+0000 mgr.smithi099.zfglya (mgr.14180) 550 : cephadm [INF] Adjusting osd_memory_target on smithi138 to 1944M 2024-02-19T22:08:07.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cephadm 2024-02-19T22:08:05.507778+0000 mgr.smithi099.zfglya (mgr.14180) 550 : cephadm [INF] Adjusting osd_memory_target on smithi138 to 1944M 2024-02-19T22:08:07.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1533017 17.06 MB/sec execute 372 sec latency 440.749 ms 2024-02-19T22:08:07.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 824210 8.92 MB/sec execute 376 sec latency 41.217 ms 2024-02-19T22:08:08.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:06.507834+0000 mgr.smithi099.zfglya (mgr.14180) 551 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.6 MiB/s wr, 177 op/s 2024-02-19T22:08:08.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:06.507834+0000 mgr.smithi099.zfglya (mgr.14180) 551 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.1 KiB/s rd, 3.6 MiB/s wr, 177 op/s 2024-02-19T22:08:08.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1535406 17.05 MB/sec execute 373 sec latency 341.836 ms 2024-02-19T22:08:08.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 825886 8.91 MB/sec execute 377 sec latency 19.801 ms 2024-02-19T22:08:09.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1538899 17.06 MB/sec execute 374 sec latency 48.237 ms 2024-02-19T22:08:09.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 827590 8.92 MB/sec execute 378 sec latency 13.752 ms 2024-02-19T22:08:10.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:08.508483+0000 mgr.smithi099.zfglya (mgr.14180) 552 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-02-19T22:08:10.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:08.508483+0000 mgr.smithi099.zfglya (mgr.14180) 552 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-02-19T22:08:10.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1542441 17.06 MB/sec execute 375 sec latency 33.225 ms 2024-02-19T22:08:10.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 829089 8.91 MB/sec execute 379 sec latency 10.345 ms 2024-02-19T22:08:11.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1545065 17.06 MB/sec execute 376 sec latency 27.650 ms 2024-02-19T22:08:11.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 830905 8.92 MB/sec execute 380 sec latency 11.031 ms 2024-02-19T22:08:12.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:10.508962+0000 mgr.smithi099.zfglya (mgr.14180) 553 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 189 op/s 2024-02-19T22:08:12.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:10.508962+0000 mgr.smithi099.zfglya (mgr.14180) 553 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 189 op/s 2024-02-19T22:08:12.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1548226 17.06 MB/sec execute 377 sec latency 41.852 ms 2024-02-19T22:08:12.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 832309 8.91 MB/sec execute 381 sec latency 23.761 ms 2024-02-19T22:08:13.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1551232 17.05 MB/sec execute 378 sec latency 29.039 ms 2024-02-19T22:08:13.798 INFO:tasks.workunit.client.1.smithi138.stdout: 1 834103 8.92 MB/sec execute 382 sec latency 15.067 ms 2024-02-19T22:08:14.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:12.509469+0000 mgr.smithi099.zfglya (mgr.14180) 554 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.9 MiB/s wr, 187 op/s 2024-02-19T22:08:14.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:12.509469+0000 mgr.smithi099.zfglya (mgr.14180) 554 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.9 MiB/s wr, 187 op/s 2024-02-19T22:08:14.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1554288 17.05 MB/sec execute 379 sec latency 41.645 ms 2024-02-19T22:08:14.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 835514 8.91 MB/sec execute 383 sec latency 11.490 ms 2024-02-19T22:08:15.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1556934 17.04 MB/sec execute 380 sec latency 49.588 ms 2024-02-19T22:08:15.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 837543 8.92 MB/sec execute 384 sec latency 5.185 ms 2024-02-19T22:08:16.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:14.509907+0000 mgr.smithi099.zfglya (mgr.14180) 555 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 3.9 MiB/s wr, 182 op/s 2024-02-19T22:08:16.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:14.509907+0000 mgr.smithi099.zfglya (mgr.14180) 555 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 3.9 MiB/s wr, 182 op/s 2024-02-19T22:08:16.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1560477 17.05 MB/sec execute 381 sec latency 27.970 ms 2024-02-19T22:08:16.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 838871 8.91 MB/sec execute 385 sec latency 7.079 ms 2024-02-19T22:08:17.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1563964 17.05 MB/sec execute 382 sec latency 26.963 ms 2024-02-19T22:08:17.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 840653 8.91 MB/sec execute 386 sec latency 8.482 ms 2024-02-19T22:08:18.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:16.510370+0000 mgr.smithi099.zfglya (mgr.14180) 556 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 3.9 MiB/s wr, 192 op/s 2024-02-19T22:08:18.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:16.510370+0000 mgr.smithi099.zfglya (mgr.14180) 556 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 3.9 MiB/s wr, 192 op/s 2024-02-19T22:08:18.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1567323 17.06 MB/sec execute 383 sec latency 125.649 ms 2024-02-19T22:08:18.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 842171 8.91 MB/sec execute 387 sec latency 9.132 ms 2024-02-19T22:08:19.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1570870 17.06 MB/sec execute 384 sec latency 32.739 ms 2024-02-19T22:08:19.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 843874 8.91 MB/sec execute 388 sec latency 17.951 ms 2024-02-19T22:08:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:18.510773+0000 mgr.smithi099.zfglya (mgr.14180) 557 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.4 KiB/s rd, 4.0 MiB/s wr, 210 op/s 2024-02-19T22:08:20.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:18.510773+0000 mgr.smithi099.zfglya (mgr.14180) 557 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.4 KiB/s rd, 4.0 MiB/s wr, 210 op/s 2024-02-19T22:08:20.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1574359 17.07 MB/sec execute 385 sec latency 41.681 ms 2024-02-19T22:08:20.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 845496 8.91 MB/sec execute 389 sec latency 15.429 ms 2024-02-19T22:08:21.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1577896 17.07 MB/sec execute 386 sec latency 33.205 ms 2024-02-19T22:08:21.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 847076 8.91 MB/sec execute 390 sec latency 17.997 ms 2024-02-19T22:08:22.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:20.511261+0000 mgr.smithi099.zfglya (mgr.14180) 558 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.2 MiB/s wr, 183 op/s 2024-02-19T22:08:22.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:20.511261+0000 mgr.smithi099.zfglya (mgr.14180) 558 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.2 MiB/s wr, 183 op/s 2024-02-19T22:08:22.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1580545 17.07 MB/sec execute 387 sec latency 32.968 ms 2024-02-19T22:08:22.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 848795 8.92 MB/sec execute 391 sec latency 6.183 ms 2024-02-19T22:08:23.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1583239 17.05 MB/sec execute 388 sec latency 74.242 ms 2024-02-19T22:08:23.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 850100 8.91 MB/sec execute 392 sec latency 24.429 ms 2024-02-19T22:08:24.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:22.511708+0000 mgr.smithi099.zfglya (mgr.14180) 559 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 3.9 MiB/s wr, 205 op/s 2024-02-19T22:08:24.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:22.511708+0000 mgr.smithi099.zfglya (mgr.14180) 559 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.9 KiB/s rd, 3.9 MiB/s wr, 205 op/s 2024-02-19T22:08:24.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1586205 17.05 MB/sec execute 389 sec latency 33.687 ms 2024-02-19T22:08:24.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 851878 8.91 MB/sec execute 393 sec latency 10.622 ms 2024-02-19T22:08:25.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1589490 17.06 MB/sec execute 390 sec latency 27.782 ms 2024-02-19T22:08:25.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 853158 8.90 MB/sec execute 394 sec latency 12.560 ms 2024-02-19T22:08:26.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:24.512112+0000 mgr.smithi099.zfglya (mgr.14180) 560 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 194 op/s 2024-02-19T22:08:26.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:24.512112+0000 mgr.smithi099.zfglya (mgr.14180) 560 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 4.0 MiB/s wr, 194 op/s 2024-02-19T22:08:26.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1593094 17.06 MB/sec execute 391 sec latency 50.121 ms 2024-02-19T22:08:26.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 854856 8.90 MB/sec execute 395 sec latency 4.564 ms 2024-02-19T22:08:27.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1596485 17.07 MB/sec execute 392 sec latency 25.523 ms 2024-02-19T22:08:27.783 INFO:tasks.workunit.client.1.smithi138.stdout: 1 856243 8.90 MB/sec execute 396 sec latency 7.766 ms 2024-02-19T22:08:28.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:26.512570+0000 mgr.smithi099.zfglya (mgr.14180) 561 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.6 MiB/s wr, 161 op/s 2024-02-19T22:08:28.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:26.512570+0000 mgr.smithi099.zfglya (mgr.14180) 561 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.2 KiB/s rd, 3.6 MiB/s wr, 161 op/s 2024-02-19T22:08:28.624 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1599535 17.06 MB/sec execute 393 sec latency 49.832 ms 2024-02-19T22:08:28.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 857830 8.89 MB/sec execute 397 sec latency 24.294 ms 2024-02-19T22:08:29.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1602974 17.07 MB/sec execute 394 sec latency 27.534 ms 2024-02-19T22:08:29.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 859490 8.90 MB/sec execute 398 sec latency 8.366 ms 2024-02-19T22:08:30.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:28.512988+0000 mgr.smithi099.zfglya (mgr.14180) 562 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.6 MiB/s wr, 188 op/s 2024-02-19T22:08:30.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:28.512988+0000 mgr.smithi099.zfglya (mgr.14180) 562 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.6 MiB/s wr, 188 op/s 2024-02-19T22:08:30.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1606446 17.07 MB/sec execute 395 sec latency 27.071 ms 2024-02-19T22:08:30.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 860862 8.90 MB/sec execute 399 sec latency 11.373 ms 2024-02-19T22:08:31.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1609921 17.08 MB/sec execute 396 sec latency 47.340 ms 2024-02-19T22:08:31.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 862564 8.90 MB/sec execute 400 sec latency 9.149 ms 2024-02-19T22:08:32.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:30.513485+0000 mgr.smithi099.zfglya (mgr.14180) 563 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 172 op/s 2024-02-19T22:08:32.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:30.513485+0000 mgr.smithi099.zfglya (mgr.14180) 563 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 172 op/s 2024-02-19T22:08:32.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1613414 17.08 MB/sec execute 397 sec latency 74.974 ms 2024-02-19T22:08:32.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 863921 8.89 MB/sec execute 401 sec latency 16.775 ms 2024-02-19T22:08:33.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1616501 17.09 MB/sec execute 398 sec latency 58.879 ms 2024-02-19T22:08:33.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 865716 8.90 MB/sec execute 402 sec latency 8.488 ms 2024-02-19T22:08:34.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:32.513994+0000 mgr.smithi099.zfglya (mgr.14180) 564 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.9 MiB/s wr, 208 op/s 2024-02-19T22:08:34.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:32.513994+0000 mgr.smithi099.zfglya (mgr.14180) 564 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.9 MiB/s wr, 208 op/s 2024-02-19T22:08:34.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1619465 17.08 MB/sec execute 399 sec latency 50.128 ms 2024-02-19T22:08:34.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 867040 8.89 MB/sec execute 403 sec latency 13.132 ms 2024-02-19T22:08:35.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1622586 17.08 MB/sec execute 400 sec latency 26.760 ms 2024-02-19T22:08:35.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 868670 8.89 MB/sec execute 404 sec latency 6.828 ms 2024-02-19T22:08:36.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:34.514448+0000 mgr.smithi099.zfglya (mgr.14180) 565 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 3.8 MiB/s wr, 161 op/s 2024-02-19T22:08:36.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:34.514448+0000 mgr.smithi099.zfglya (mgr.14180) 565 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 3.8 MiB/s wr, 161 op/s 2024-02-19T22:08:36.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1625400 17.07 MB/sec execute 401 sec latency 50.076 ms 2024-02-19T22:08:36.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 870273 8.89 MB/sec execute 405 sec latency 11.195 ms 2024-02-19T22:08:37.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1629329 17.08 MB/sec execute 402 sec latency 26.672 ms 2024-02-19T22:08:37.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 871890 8.89 MB/sec execute 406 sec latency 12.149 ms 2024-02-19T22:08:38.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:36.514889+0000 mgr.smithi099.zfglya (mgr.14180) 566 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 3.5 MiB/s wr, 171 op/s 2024-02-19T22:08:38.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:36.514889+0000 mgr.smithi099.zfglya (mgr.14180) 566 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 3.5 MiB/s wr, 171 op/s 2024-02-19T22:08:38.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1632347 17.08 MB/sec execute 403 sec latency 32.462 ms 2024-02-19T22:08:38.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 873645 8.90 MB/sec execute 407 sec latency 8.122 ms 2024-02-19T22:08:39.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1633648 17.06 MB/sec execute 404 sec latency 450.110 ms 2024-02-19T22:08:39.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 875050 8.89 MB/sec execute 408 sec latency 11.329 ms 2024-02-19T22:08:40.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:38.515336+0000 mgr.smithi099.zfglya (mgr.14180) 567 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.7 MiB/s wr, 198 op/s 2024-02-19T22:08:40.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:38.515336+0000 mgr.smithi099.zfglya (mgr.14180) 567 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.7 MiB/s wr, 198 op/s 2024-02-19T22:08:40.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1634994 17.03 MB/sec execute 405 sec latency 279.874 ms 2024-02-19T22:08:40.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 876773 8.89 MB/sec execute 409 sec latency 15.008 ms 2024-02-19T22:08:41.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1638468 17.03 MB/sec execute 406 sec latency 33.367 ms 2024-02-19T22:08:41.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 878212 8.88 MB/sec execute 410 sec latency 21.888 ms 2024-02-19T22:08:42.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:40.515785+0000 mgr.smithi099.zfglya (mgr.14180) 568 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 4.2 MiB/s wr, 181 op/s 2024-02-19T22:08:42.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:40.515785+0000 mgr.smithi099.zfglya (mgr.14180) 568 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 4.2 MiB/s wr, 181 op/s 2024-02-19T22:08:42.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1641976 17.04 MB/sec execute 407 sec latency 48.367 ms 2024-02-19T22:08:42.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 880192 8.89 MB/sec execute 411 sec latency 13.187 ms 2024-02-19T22:08:43.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1645444 17.04 MB/sec execute 408 sec latency 27.378 ms 2024-02-19T22:08:43.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 881477 8.88 MB/sec execute 412 sec latency 17.385 ms 2024-02-19T22:08:44.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:42.516269+0000 mgr.smithi099.zfglya (mgr.14180) 569 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 4.0 MiB/s wr, 215 op/s 2024-02-19T22:08:44.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:42.516269+0000 mgr.smithi099.zfglya (mgr.14180) 569 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 4.0 MiB/s wr, 215 op/s 2024-02-19T22:08:44.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1648986 17.05 MB/sec execute 409 sec latency 27.364 ms 2024-02-19T22:08:44.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 883246 8.89 MB/sec execute 413 sec latency 14.206 ms 2024-02-19T22:08:45.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1652463 17.05 MB/sec execute 410 sec latency 49.685 ms 2024-02-19T22:08:45.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 884755 8.89 MB/sec execute 414 sec latency 14.313 ms 2024-02-19T22:08:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:44.516713+0000 mgr.smithi099.zfglya (mgr.14180) 570 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.8 MiB/s wr, 165 op/s 2024-02-19T22:08:46.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:44.516713+0000 mgr.smithi099.zfglya (mgr.14180) 570 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.8 MiB/s wr, 165 op/s 2024-02-19T22:08:46.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1655963 17.06 MB/sec execute 411 sec latency 27.787 ms 2024-02-19T22:08:46.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 886427 8.88 MB/sec execute 415 sec latency 29.200 ms 2024-02-19T22:08:47.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1659495 17.06 MB/sec execute 412 sec latency 55.061 ms 2024-02-19T22:08:47.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 888033 8.89 MB/sec execute 416 sec latency 11.817 ms 2024-02-19T22:08:48.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:46.517198+0000 mgr.smithi099.zfglya (mgr.14180) 571 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.6 MiB/s wr, 175 op/s 2024-02-19T22:08:48.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:46.517198+0000 mgr.smithi099.zfglya (mgr.14180) 571 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.6 MiB/s wr, 175 op/s 2024-02-19T22:08:48.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1662153 17.06 MB/sec execute 413 sec latency 33.408 ms 2024-02-19T22:08:48.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 889648 8.88 MB/sec execute 417 sec latency 9.694 ms 2024-02-19T22:08:49.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1665560 17.06 MB/sec execute 414 sec latency 41.551 ms 2024-02-19T22:08:49.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 891380 8.89 MB/sec execute 418 sec latency 7.843 ms 2024-02-19T22:08:50.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:48.517628+0000 mgr.smithi099.zfglya (mgr.14180) 572 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-02-19T22:08:50.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:48.517628+0000 mgr.smithi099.zfglya (mgr.14180) 572 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-02-19T22:08:50.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1667801 17.04 MB/sec execute 415 sec latency 104.614 ms 2024-02-19T22:08:50.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 892874 8.88 MB/sec execute 419 sec latency 25.557 ms 2024-02-19T22:08:51.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1671095 17.05 MB/sec execute 416 sec latency 33.698 ms 2024-02-19T22:08:51.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 894675 8.89 MB/sec execute 420 sec latency 15.155 ms 2024-02-19T22:08:52.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:50.518076+0000 mgr.smithi099.zfglya (mgr.14180) 573 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.2 MiB/s wr, 184 op/s 2024-02-19T22:08:52.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:50.518076+0000 mgr.smithi099.zfglya (mgr.14180) 573 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.2 MiB/s wr, 184 op/s 2024-02-19T22:08:52.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1673995 17.04 MB/sec execute 417 sec latency 28.014 ms 2024-02-19T22:08:52.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 896149 8.89 MB/sec execute 421 sec latency 14.215 ms 2024-02-19T22:08:53.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1677364 17.05 MB/sec execute 418 sec latency 52.990 ms 2024-02-19T22:08:53.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 897972 8.89 MB/sec execute 422 sec latency 17.011 ms 2024-02-19T22:08:54.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:52.518610+0000 mgr.smithi099.zfglya (mgr.14180) 574 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.9 MiB/s wr, 210 op/s 2024-02-19T22:08:54.549 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:52.518610+0000 mgr.smithi099.zfglya (mgr.14180) 574 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.9 MiB/s wr, 210 op/s 2024-02-19T22:08:54.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1680898 17.05 MB/sec execute 419 sec latency 27.502 ms 2024-02-19T22:08:54.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 899374 8.88 MB/sec execute 423 sec latency 15.616 ms 2024-02-19T22:08:55.625 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1684328 17.06 MB/sec execute 420 sec latency 73.731 ms 2024-02-19T22:08:55.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 901216 8.89 MB/sec execute 424 sec latency 15.509 ms 2024-02-19T22:08:56.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:54.519033+0000 mgr.smithi099.zfglya (mgr.14180) 575 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.9 MiB/s wr, 168 op/s 2024-02-19T22:08:56.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:54.519033+0000 mgr.smithi099.zfglya (mgr.14180) 575 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.9 MiB/s wr, 168 op/s 2024-02-19T22:08:56.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1687120 17.06 MB/sec execute 421 sec latency 30.561 ms 2024-02-19T22:08:56.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 902685 8.88 MB/sec execute 425 sec latency 8.290 ms 2024-02-19T22:08:57.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1690482 17.06 MB/sec execute 422 sec latency 33.240 ms 2024-02-19T22:08:57.784 INFO:tasks.workunit.client.1.smithi138.stdout: 1 904329 8.88 MB/sec execute 426 sec latency 17.983 ms 2024-02-19T22:08:58.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:08:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:56.519493+0000 mgr.smithi099.zfglya (mgr.14180) 576 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.9 MiB/s wr, 181 op/s 2024-02-19T22:08:58.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:08:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:56.519493+0000 mgr.smithi099.zfglya (mgr.14180) 576 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.9 MiB/s wr, 181 op/s 2024-02-19T22:08:58.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1693215 17.04 MB/sec execute 423 sec latency 56.336 ms 2024-02-19T22:08:58.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 905892 8.88 MB/sec execute 427 sec latency 13.910 ms 2024-02-19T22:08:59.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1696170 17.04 MB/sec execute 424 sec latency 33.699 ms 2024-02-19T22:08:59.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 907491 8.88 MB/sec execute 428 sec latency 21.483 ms 2024-02-19T22:09:00.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:08:58.519906+0000 mgr.smithi099.zfglya (mgr.14180) 577 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.9 MiB/s wr, 209 op/s 2024-02-19T22:09:00.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:08:58.519906+0000 mgr.smithi099.zfglya (mgr.14180) 577 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.9 MiB/s wr, 209 op/s 2024-02-19T22:09:00.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1699315 17.05 MB/sec execute 425 sec latency 33.670 ms 2024-02-19T22:09:00.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 909176 8.89 MB/sec execute 429 sec latency 7.966 ms 2024-02-19T22:09:01.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1702256 17.04 MB/sec execute 426 sec latency 57.429 ms 2024-02-19T22:09:01.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 910665 8.88 MB/sec execute 430 sec latency 16.099 ms 2024-02-19T22:09:02.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:00.520382+0000 mgr.smithi099.zfglya (mgr.14180) 578 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 193 op/s 2024-02-19T22:09:02.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:00.520382+0000 mgr.smithi099.zfglya (mgr.14180) 578 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 193 op/s 2024-02-19T22:09:02.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1705727 17.05 MB/sec execute 427 sec latency 27.712 ms 2024-02-19T22:09:02.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 912414 8.89 MB/sec execute 431 sec latency 10.789 ms 2024-02-19T22:09:03.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1709205 17.05 MB/sec execute 428 sec latency 50.083 ms 2024-02-19T22:09:03.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 913787 8.88 MB/sec execute 432 sec latency 7.146 ms 2024-02-19T22:09:04.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:02.520809+0000 mgr.smithi099.zfglya (mgr.14180) 579 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 4.0 MiB/s wr, 218 op/s 2024-02-19T22:09:04.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:02.520809+0000 mgr.smithi099.zfglya (mgr.14180) 579 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 4.0 MiB/s wr, 218 op/s 2024-02-19T22:09:04.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1712743 17.06 MB/sec execute 429 sec latency 33.175 ms 2024-02-19T22:09:04.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 915665 8.88 MB/sec execute 433 sec latency 7.039 ms 2024-02-19T22:09:05.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1716234 17.06 MB/sec execute 430 sec latency 33.726 ms 2024-02-19T22:09:05.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 916689 8.87 MB/sec execute 434 sec latency 25.746 ms 2024-02-19T22:09:06.374 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:04.521274+0000 mgr.smithi099.zfglya (mgr.14180) 580 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.8 MiB/s wr, 178 op/s 2024-02-19T22:09:06.374 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:09:05.522330+0000 mon.smithi099 (mon.0) 781 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:09:06.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:04.521274+0000 mgr.smithi099.zfglya (mgr.14180) 580 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.8 MiB/s wr, 178 op/s 2024-02-19T22:09:06.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:09:05.522330+0000 mon.smithi099 (mon.0) 781 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:09:06.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1717897 17.04 MB/sec execute 431 sec latency 83.314 ms 2024-02-19T22:09:06.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 918341 8.91 MB/sec execute 435 sec latency 21.248 ms 2024-02-19T22:09:07.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1719907 17.03 MB/sec execute 432 sec latency 66.556 ms 2024-02-19T22:09:07.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 920020 8.91 MB/sec execute 436 sec latency 9.377 ms 2024-02-19T22:09:08.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:06.521722+0000 mgr.smithi099.zfglya (mgr.14180) 581 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.7 MiB/s wr, 187 op/s 2024-02-19T22:09:08.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:09:07.955019+0000 mon.smithi099 (mon.0) 782 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:09:08.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:06.521722+0000 mgr.smithi099.zfglya (mgr.14180) 581 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.7 MiB/s wr, 187 op/s 2024-02-19T22:09:08.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:09:07.955019+0000 mon.smithi099 (mon.0) 782 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:09:08.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1722400 17.02 MB/sec execute 433 sec latency 66.236 ms 2024-02-19T22:09:08.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 921240 8.91 MB/sec execute 437 sec latency 20.326 ms 2024-02-19T22:09:09.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1723632 16.99 MB/sec execute 434 sec latency 58.800 ms 2024-02-19T22:09:09.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 922963 8.91 MB/sec execute 438 sec latency 11.495 ms 2024-02-19T22:09:10.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:08.522110+0000 mgr.smithi099.zfglya (mgr.14180) 582 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.8 MiB/s wr, 192 op/s 2024-02-19T22:09:10.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:08.522110+0000 mgr.smithi099.zfglya (mgr.14180) 582 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.8 MiB/s wr, 192 op/s 2024-02-19T22:09:10.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1726868 17.00 MB/sec execute 435 sec latency 88.488 ms 2024-02-19T22:09:10.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 924403 8.91 MB/sec execute 439 sec latency 15.624 ms 2024-02-19T22:09:11.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1726875 16.96 MB/sec execute 436 sec latency 475.363 ms 2024-02-19T22:09:11.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 926085 8.90 MB/sec execute 440 sec latency 28.100 ms 2024-02-19T22:09:12.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:10.522729+0000 mgr.smithi099.zfglya (mgr.14180) 583 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 193 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 5.8 MiB/s wr, 207 op/s 2024-02-19T22:09:12.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:10.522729+0000 mgr.smithi099.zfglya (mgr.14180) 583 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 193 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 5.8 MiB/s wr, 207 op/s 2024-02-19T22:09:12.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1727678 16.93 MB/sec execute 437 sec latency 359.028 ms 2024-02-19T22:09:12.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 927697 8.91 MB/sec execute 441 sec latency 5.652 ms 2024-02-19T22:09:13.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1730616 16.92 MB/sec execute 438 sec latency 66.601 ms 2024-02-19T22:09:13.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 929169 8.90 MB/sec execute 442 sec latency 22.273 ms 2024-02-19T22:09:14.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:12.523148+0000 mgr.smithi099.zfglya (mgr.14180) 584 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 5.1 MiB/s wr, 190 op/s 2024-02-19T22:09:14.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:09:13.040722+0000 mon.smithi099 (mon.0) 783 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:09:14.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:09:13.369494+0000 mon.smithi099 (mon.0) 784 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:09:14.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:09:13.370244+0000 mon.smithi099 (mon.0) 785 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:09:14.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:09:13.374318+0000 mon.smithi099 (mon.0) 786 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:09:14.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:12.523148+0000 mgr.smithi099.zfglya (mgr.14180) 584 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 5.1 MiB/s wr, 190 op/s 2024-02-19T22:09:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:09:13.040722+0000 mon.smithi099 (mon.0) 783 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:09:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:09:13.369494+0000 mon.smithi099 (mon.0) 784 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:09:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:09:13.370244+0000 mon.smithi099 (mon.0) 785 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:09:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:09:13.374318+0000 mon.smithi099 (mon.0) 786 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:09:14.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1734087 16.93 MB/sec execute 439 sec latency 49.420 ms 2024-02-19T22:09:14.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 930956 8.91 MB/sec execute 443 sec latency 13.646 ms 2024-02-19T22:09:15.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1737565 16.93 MB/sec execute 440 sec latency 27.523 ms 2024-02-19T22:09:15.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 932336 8.90 MB/sec execute 444 sec latency 7.398 ms 2024-02-19T22:09:16.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:14.523535+0000 mgr.smithi099.zfglya (mgr.14180) 585 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 5.1 MiB/s wr, 190 op/s 2024-02-19T22:09:16.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:14.523535+0000 mgr.smithi099.zfglya (mgr.14180) 585 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 5.1 MiB/s wr, 190 op/s 2024-02-19T22:09:16.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1741104 16.94 MB/sec execute 441 sec latency 33.663 ms 2024-02-19T22:09:16.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 934181 8.90 MB/sec execute 445 sec latency 4.614 ms 2024-02-19T22:09:17.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1744592 16.94 MB/sec execute 442 sec latency 49.987 ms 2024-02-19T22:09:17.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 935435 8.90 MB/sec execute 446 sec latency 17.570 ms 2024-02-19T22:09:18.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:16.523995+0000 mgr.smithi099.zfglya (mgr.14180) 586 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 5.4 MiB/s wr, 198 op/s 2024-02-19T22:09:18.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:16.523995+0000 mgr.smithi099.zfglya (mgr.14180) 586 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 5.4 MiB/s wr, 198 op/s 2024-02-19T22:09:18.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1747218 16.94 MB/sec execute 443 sec latency 32.291 ms 2024-02-19T22:09:18.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 937215 8.90 MB/sec execute 447 sec latency 13.482 ms 2024-02-19T22:09:19.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1750230 16.93 MB/sec execute 444 sec latency 58.061 ms 2024-02-19T22:09:19.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 938694 8.90 MB/sec execute 448 sec latency 7.459 ms 2024-02-19T22:09:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:18.524438+0000 mgr.smithi099.zfglya (mgr.14180) 587 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.5 KiB/s rd, 5.1 MiB/s wr, 186 op/s 2024-02-19T22:09:20.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:18.524438+0000 mgr.smithi099.zfglya (mgr.14180) 587 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.5 KiB/s rd, 5.1 MiB/s wr, 186 op/s 2024-02-19T22:09:20.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1753392 16.93 MB/sec execute 445 sec latency 31.762 ms 2024-02-19T22:09:20.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 940367 8.89 MB/sec execute 449 sec latency 10.470 ms 2024-02-19T22:09:21.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1756235 16.93 MB/sec execute 446 sec latency 32.526 ms 2024-02-19T22:09:21.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 941970 8.90 MB/sec execute 450 sec latency 15.657 ms 2024-02-19T22:09:22.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:20.524882+0000 mgr.smithi099.zfglya (mgr.14180) 588 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 5.8 MiB/s wr, 218 op/s 2024-02-19T22:09:22.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:20.524882+0000 mgr.smithi099.zfglya (mgr.14180) 588 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 5.8 MiB/s wr, 218 op/s 2024-02-19T22:09:22.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1758944 16.93 MB/sec execute 447 sec latency 200.040 ms 2024-02-19T22:09:22.785 INFO:tasks.workunit.client.1.smithi138.stdout: 1 943488 8.89 MB/sec execute 451 sec latency 17.706 ms 2024-02-19T22:09:23.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1762453 16.93 MB/sec execute 448 sec latency 41.713 ms 2024-02-19T22:09:23.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 945264 8.90 MB/sec execute 452 sec latency 7.798 ms 2024-02-19T22:09:24.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:22.525338+0000 mgr.smithi099.zfglya (mgr.14180) 589 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.5 KiB/s rd, 3.6 MiB/s wr, 196 op/s 2024-02-19T22:09:24.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:22.525338+0000 mgr.smithi099.zfglya (mgr.14180) 589 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.5 KiB/s rd, 3.6 MiB/s wr, 196 op/s 2024-02-19T22:09:24.626 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1765989 16.94 MB/sec execute 449 sec latency 33.503 ms 2024-02-19T22:09:24.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 946636 8.90 MB/sec execute 453 sec latency 21.175 ms 2024-02-19T22:09:25.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1769484 16.94 MB/sec execute 450 sec latency 50.140 ms 2024-02-19T22:09:25.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 948422 8.90 MB/sec execute 454 sec latency 13.216 ms 2024-02-19T22:09:26.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:24.525739+0000 mgr.smithi099.zfglya (mgr.14180) 590 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 3.6 MiB/s wr, 189 op/s 2024-02-19T22:09:26.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:24.525739+0000 mgr.smithi099.zfglya (mgr.14180) 590 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 3.6 MiB/s wr, 189 op/s 2024-02-19T22:09:26.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1773018 16.94 MB/sec execute 451 sec latency 41.496 ms 2024-02-19T22:09:26.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 949788 8.89 MB/sec execute 455 sec latency 8.154 ms 2024-02-19T22:09:27.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1775321 16.93 MB/sec execute 452 sec latency 82.994 ms 2024-02-19T22:09:27.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 951619 8.90 MB/sec execute 456 sec latency 13.305 ms 2024-02-19T22:09:28.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:26.526173+0000 mgr.smithi099.zfglya (mgr.14180) 591 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 4.0 MiB/s wr, 161 op/s 2024-02-19T22:09:28.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:26.526173+0000 mgr.smithi099.zfglya (mgr.14180) 591 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 4.0 MiB/s wr, 161 op/s 2024-02-19T22:09:28.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1778369 16.93 MB/sec execute 453 sec latency 50.042 ms 2024-02-19T22:09:28.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 952997 8.89 MB/sec execute 457 sec latency 13.502 ms 2024-02-19T22:09:29.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1781810 16.93 MB/sec execute 454 sec latency 32.371 ms 2024-02-19T22:09:29.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 954613 8.89 MB/sec execute 458 sec latency 8.705 ms 2024-02-19T22:09:30.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:28.526586+0000 mgr.smithi099.zfglya (mgr.14180) 592 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.6 MiB/s wr, 190 op/s 2024-02-19T22:09:30.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:28.526586+0000 mgr.smithi099.zfglya (mgr.14180) 592 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.6 MiB/s wr, 190 op/s 2024-02-19T22:09:30.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1784873 16.93 MB/sec execute 455 sec latency 50.150 ms 2024-02-19T22:09:30.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 956190 8.89 MB/sec execute 459 sec latency 18.011 ms 2024-02-19T22:09:31.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1788161 16.94 MB/sec execute 456 sec latency 41.788 ms 2024-02-19T22:09:31.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 957783 8.89 MB/sec execute 460 sec latency 12.135 ms 2024-02-19T22:09:32.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:30.527351+0000 mgr.smithi099.zfglya (mgr.14180) 593 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.5 MiB/s wr, 205 op/s 2024-02-19T22:09:32.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:30.527351+0000 mgr.smithi099.zfglya (mgr.14180) 593 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.5 MiB/s wr, 205 op/s 2024-02-19T22:09:32.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1790996 16.93 MB/sec execute 457 sec latency 75.082 ms 2024-02-19T22:09:32.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 959519 8.90 MB/sec execute 461 sec latency 8.024 ms 2024-02-19T22:09:33.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1794423 16.94 MB/sec execute 458 sec latency 48.863 ms 2024-02-19T22:09:33.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 960885 8.89 MB/sec execute 462 sec latency 14.850 ms 2024-02-19T22:09:34.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:32.527766+0000 mgr.smithi099.zfglya (mgr.14180) 594 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.7 MiB/s wr, 198 op/s 2024-02-19T22:09:34.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:32.527766+0000 mgr.smithi099.zfglya (mgr.14180) 594 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.7 MiB/s wr, 198 op/s 2024-02-19T22:09:34.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1797966 16.94 MB/sec execute 459 sec latency 27.491 ms 2024-02-19T22:09:34.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 962620 8.89 MB/sec execute 463 sec latency 11.083 ms 2024-02-19T22:09:35.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1801445 16.95 MB/sec execute 460 sec latency 41.661 ms 2024-02-19T22:09:35.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 964011 8.88 MB/sec execute 464 sec latency 14.165 ms 2024-02-19T22:09:36.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:34.528163+0000 mgr.smithi099.zfglya (mgr.14180) 595 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.7 MiB/s wr, 172 op/s 2024-02-19T22:09:36.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:34.528163+0000 mgr.smithi099.zfglya (mgr.14180) 595 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.7 MiB/s wr, 172 op/s 2024-02-19T22:09:36.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1804943 16.95 MB/sec execute 461 sec latency 50.413 ms 2024-02-19T22:09:36.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 965813 8.89 MB/sec execute 465 sec latency 9.359 ms 2024-02-19T22:09:37.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1808481 16.96 MB/sec execute 462 sec latency 28.140 ms 2024-02-19T22:09:37.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 967200 8.88 MB/sec execute 466 sec latency 13.421 ms 2024-02-19T22:09:38.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:36.528606+0000 mgr.smithi099.zfglya (mgr.14180) 596 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.3 MiB/s wr, 188 op/s 2024-02-19T22:09:38.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:36.528606+0000 mgr.smithi099.zfglya (mgr.14180) 596 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.3 MiB/s wr, 188 op/s 2024-02-19T22:09:38.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1811133 16.95 MB/sec execute 463 sec latency 57.653 ms 2024-02-19T22:09:38.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 968827 8.88 MB/sec execute 467 sec latency 20.466 ms 2024-02-19T22:09:39.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1814647 16.95 MB/sec execute 464 sec latency 27.191 ms 2024-02-19T22:09:39.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 970388 8.89 MB/sec execute 468 sec latency 15.054 ms 2024-02-19T22:09:40.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:38.529086+0000 mgr.smithi099.zfglya (mgr.14180) 597 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.5 MiB/s wr, 178 op/s 2024-02-19T22:09:40.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:38.529086+0000 mgr.smithi099.zfglya (mgr.14180) 597 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.5 MiB/s wr, 178 op/s 2024-02-19T22:09:40.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1818082 16.96 MB/sec execute 465 sec latency 28.238 ms 2024-02-19T22:09:40.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 971950 8.88 MB/sec execute 469 sec latency 13.333 ms 2024-02-19T22:09:41.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1821355 16.96 MB/sec execute 466 sec latency 50.102 ms 2024-02-19T22:09:41.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 973700 8.89 MB/sec execute 470 sec latency 8.464 ms 2024-02-19T22:09:42.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:40.529666+0000 mgr.smithi099.zfglya (mgr.14180) 598 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 4.4 MiB/s wr, 189 op/s 2024-02-19T22:09:42.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:40.529666+0000 mgr.smithi099.zfglya (mgr.14180) 598 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 4.4 MiB/s wr, 189 op/s 2024-02-19T22:09:42.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1824457 16.95 MB/sec execute 467 sec latency 28.082 ms 2024-02-19T22:09:42.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 975060 8.88 MB/sec execute 471 sec latency 13.608 ms 2024-02-19T22:09:43.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1826203 16.94 MB/sec execute 468 sec latency 417.980 ms 2024-02-19T22:09:43.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 976797 8.88 MB/sec execute 472 sec latency 12.567 ms 2024-02-19T22:09:44.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:42.530145+0000 mgr.smithi099.zfglya (mgr.14180) 599 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.4 MiB/s wr, 193 op/s 2024-02-19T22:09:44.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:42.530145+0000 mgr.smithi099.zfglya (mgr.14180) 599 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.4 MiB/s wr, 193 op/s 2024-02-19T22:09:44.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1826339 16.91 MB/sec execute 469 sec latency 483.740 ms 2024-02-19T22:09:44.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 978158 8.88 MB/sec execute 473 sec latency 14.831 ms 2024-02-19T22:09:45.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1829870 16.91 MB/sec execute 470 sec latency 41.730 ms 2024-02-19T22:09:45.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 979946 8.88 MB/sec execute 474 sec latency 8.456 ms 2024-02-19T22:09:46.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:44.530603+0000 mgr.smithi099.zfglya (mgr.14180) 600 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 KiB/s rd, 3.5 MiB/s wr, 164 op/s 2024-02-19T22:09:46.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:44.530603+0000 mgr.smithi099.zfglya (mgr.14180) 600 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 KiB/s rd, 3.5 MiB/s wr, 164 op/s 2024-02-19T22:09:46.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1834040 16.96 MB/sec execute 471 sec latency 58.468 ms 2024-02-19T22:09:46.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 981299 8.88 MB/sec execute 475 sec latency 14.983 ms 2024-02-19T22:09:47.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1836681 16.95 MB/sec execute 472 sec latency 26.202 ms 2024-02-19T22:09:47.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 982956 8.87 MB/sec execute 476 sec latency 12.715 ms 2024-02-19T22:09:48.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:46.531046+0000 mgr.smithi099.zfglya (mgr.14180) 601 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 173 op/s 2024-02-19T22:09:48.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:46.531046+0000 mgr.smithi099.zfglya (mgr.14180) 601 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 KiB/s rd, 4.0 MiB/s wr, 173 op/s 2024-02-19T22:09:48.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1839913 16.96 MB/sec execute 473 sec latency 27.671 ms 2024-02-19T22:09:48.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 984563 8.88 MB/sec execute 477 sec latency 14.535 ms 2024-02-19T22:09:49.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1842896 16.95 MB/sec execute 474 sec latency 50.072 ms 2024-02-19T22:09:49.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 986164 8.87 MB/sec execute 478 sec latency 29.806 ms 2024-02-19T22:09:50.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:48.531482+0000 mgr.smithi099.zfglya (mgr.14180) 602 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.3 KiB/s rd, 3.4 MiB/s wr, 194 op/s 2024-02-19T22:09:50.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:48.531482+0000 mgr.smithi099.zfglya (mgr.14180) 602 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.3 KiB/s rd, 3.4 MiB/s wr, 194 op/s 2024-02-19T22:09:50.627 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1845920 16.95 MB/sec execute 475 sec latency 27.870 ms 2024-02-19T22:09:50.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 987904 8.88 MB/sec execute 479 sec latency 15.478 ms 2024-02-19T22:09:51.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1849059 16.95 MB/sec execute 476 sec latency 33.353 ms 2024-02-19T22:09:51.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 989301 8.87 MB/sec execute 480 sec latency 22.291 ms 2024-02-19T22:09:52.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:50.531936+0000 mgr.smithi099.zfglya (mgr.14180) 603 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 217 op/s 2024-02-19T22:09:52.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:50.531936+0000 mgr.smithi099.zfglya (mgr.14180) 603 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 217 op/s 2024-02-19T22:09:52.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1852006 16.95 MB/sec execute 477 sec latency 41.696 ms 2024-02-19T22:09:52.786 INFO:tasks.workunit.client.1.smithi138.stdout: 1 991075 8.87 MB/sec execute 481 sec latency 13.818 ms 2024-02-19T22:09:53.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1855510 16.95 MB/sec execute 478 sec latency 27.982 ms 2024-02-19T22:09:53.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 992516 8.87 MB/sec execute 482 sec latency 14.033 ms 2024-02-19T22:09:54.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:52.532389+0000 mgr.smithi099.zfglya (mgr.14180) 604 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.4 MiB/s wr, 168 op/s 2024-02-19T22:09:54.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:52.532389+0000 mgr.smithi099.zfglya (mgr.14180) 604 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.4 MiB/s wr, 168 op/s 2024-02-19T22:09:54.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1858995 16.96 MB/sec execute 479 sec latency 56.359 ms 2024-02-19T22:09:54.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 994430 8.87 MB/sec execute 483 sec latency 15.328 ms 2024-02-19T22:09:55.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1862474 16.96 MB/sec execute 480 sec latency 183.340 ms 2024-02-19T22:09:55.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 995683 8.87 MB/sec execute 484 sec latency 18.475 ms 2024-02-19T22:09:56.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:54.532812+0000 mgr.smithi099.zfglya (mgr.14180) 605 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.9 MiB/s wr, 188 op/s 2024-02-19T22:09:56.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:54.532812+0000 mgr.smithi099.zfglya (mgr.14180) 605 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 3.9 MiB/s wr, 188 op/s 2024-02-19T22:09:56.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1865130 16.96 MB/sec execute 481 sec latency 32.043 ms 2024-02-19T22:09:56.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 997326 8.87 MB/sec execute 485 sec latency 14.708 ms 2024-02-19T22:09:57.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1868338 16.96 MB/sec execute 482 sec latency 47.757 ms 2024-02-19T22:09:57.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 998857 8.87 MB/sec execute 486 sec latency 18.632 ms 2024-02-19T22:09:58.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:09:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:56.533277+0000 mgr.smithi099.zfglya (mgr.14180) 606 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.2 MiB/s wr, 192 op/s 2024-02-19T22:09:58.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:09:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:56.533277+0000 mgr.smithi099.zfglya (mgr.14180) 606 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 192 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.2 MiB/s wr, 192 op/s 2024-02-19T22:09:58.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1871649 16.96 MB/sec execute 483 sec latency 33.653 ms 2024-02-19T22:09:58.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1000464 8.86 MB/sec execute 487 sec latency 17.078 ms 2024-02-19T22:09:59.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1874780 16.95 MB/sec execute 484 sec latency 33.580 ms 2024-02-19T22:09:59.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1002138 8.87 MB/sec execute 488 sec latency 12.962 ms 2024-02-19T22:10:00.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:09:58.533702+0000 mgr.smithi099.zfglya (mgr.14180) 607 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.9 MiB/s wr, 215 op/s 2024-02-19T22:10:00.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:00.000081+0000 mon.smithi099 (mon.0) 787 : cluster [INF] overall HEALTH_OK 2024-02-19T22:10:00.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:09:58.533702+0000 mgr.smithi099.zfglya (mgr.14180) 607 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.9 MiB/s wr, 215 op/s 2024-02-19T22:10:00.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:00.000081+0000 mon.smithi099 (mon.0) 787 : cluster [INF] overall HEALTH_OK 2024-02-19T22:10:00.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1877611 16.95 MB/sec execute 485 sec latency 52.228 ms 2024-02-19T22:10:00.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1003480 8.87 MB/sec execute 489 sec latency 16.886 ms 2024-02-19T22:10:01.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1880450 16.95 MB/sec execute 486 sec latency 41.703 ms 2024-02-19T22:10:01.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1005193 8.87 MB/sec execute 490 sec latency 10.694 ms 2024-02-19T22:10:02.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:00.534154+0000 mgr.smithi099.zfglya (mgr.14180) 608 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.6 MiB/s wr, 193 op/s 2024-02-19T22:10:02.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:00.534154+0000 mgr.smithi099.zfglya (mgr.14180) 608 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.6 MiB/s wr, 193 op/s 2024-02-19T22:10:02.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1883877 16.95 MB/sec execute 487 sec latency 32.339 ms 2024-02-19T22:10:02.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1006589 8.86 MB/sec execute 491 sec latency 14.123 ms 2024-02-19T22:10:03.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1887413 16.96 MB/sec execute 488 sec latency 58.153 ms 2024-02-19T22:10:03.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1008401 8.87 MB/sec execute 492 sec latency 15.456 ms 2024-02-19T22:10:04.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:02.534698+0000 mgr.smithi099.zfglya (mgr.14180) 609 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.6 MiB/s wr, 169 op/s 2024-02-19T22:10:04.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:02.534698+0000 mgr.smithi099.zfglya (mgr.14180) 609 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.6 MiB/s wr, 169 op/s 2024-02-19T22:10:04.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1890891 16.96 MB/sec execute 489 sec latency 33.694 ms 2024-02-19T22:10:04.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1009784 8.86 MB/sec execute 493 sec latency 8.230 ms 2024-02-19T22:10:05.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1894386 16.97 MB/sec execute 490 sec latency 53.909 ms 2024-02-19T22:10:05.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1011430 8.86 MB/sec execute 494 sec latency 19.758 ms 2024-02-19T22:10:06.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:04.535091+0000 mgr.smithi099.zfglya (mgr.14180) 610 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.7 MiB/s wr, 189 op/s 2024-02-19T22:10:06.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:04.535091+0000 mgr.smithi099.zfglya (mgr.14180) 610 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.7 MiB/s wr, 189 op/s 2024-02-19T22:10:06.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1897040 16.96 MB/sec execute 491 sec latency 29.835 ms 2024-02-19T22:10:06.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1013004 8.86 MB/sec execute 495 sec latency 13.504 ms 2024-02-19T22:10:07.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1900441 16.96 MB/sec execute 492 sec latency 27.983 ms 2024-02-19T22:10:07.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1014588 8.86 MB/sec execute 496 sec latency 16.846 ms 2024-02-19T22:10:08.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:06.535570+0000 mgr.smithi099.zfglya (mgr.14180) 611 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 4.1 MiB/s wr, 197 op/s 2024-02-19T22:10:08.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:06.535570+0000 mgr.smithi099.zfglya (mgr.14180) 611 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 4.1 MiB/s wr, 197 op/s 2024-02-19T22:10:08.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1903274 16.96 MB/sec execute 493 sec latency 47.217 ms 2024-02-19T22:10:08.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1016305 8.87 MB/sec execute 497 sec latency 10.283 ms 2024-02-19T22:10:09.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1906234 16.96 MB/sec execute 494 sec latency 33.268 ms 2024-02-19T22:10:09.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1017658 8.86 MB/sec execute 498 sec latency 29.184 ms 2024-02-19T22:10:10.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:08.535985+0000 mgr.smithi099.zfglya (mgr.14180) 612 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.7 MiB/s wr, 185 op/s 2024-02-19T22:10:10.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:08.535985+0000 mgr.smithi099.zfglya (mgr.14180) 612 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.7 MiB/s wr, 185 op/s 2024-02-19T22:10:10.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1909557 16.96 MB/sec execute 495 sec latency 39.035 ms 2024-02-19T22:10:10.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1019378 8.86 MB/sec execute 499 sec latency 9.331 ms 2024-02-19T22:10:11.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1912386 16.96 MB/sec execute 496 sec latency 47.386 ms 2024-02-19T22:10:11.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1020731 8.86 MB/sec execute 500 sec latency 13.455 ms 2024-02-19T22:10:12.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:10.536431+0000 mgr.smithi099.zfglya (mgr.14180) 613 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 3.9 MiB/s wr, 158 op/s 2024-02-19T22:10:12.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:10.536431+0000 mgr.smithi099.zfglya (mgr.14180) 613 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 3.9 MiB/s wr, 158 op/s 2024-02-19T22:10:12.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1915821 16.96 MB/sec execute 497 sec latency 30.575 ms 2024-02-19T22:10:12.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1022517 8.86 MB/sec execute 501 sec latency 5.314 ms 2024-02-19T22:10:13.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1919297 16.96 MB/sec execute 498 sec latency 46.439 ms 2024-02-19T22:10:13.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1023824 8.86 MB/sec execute 502 sec latency 16.354 ms 2024-02-19T22:10:14.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:12.536915+0000 mgr.smithi099.zfglya (mgr.14180) 614 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 193 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.4 MiB/s wr, 196 op/s 2024-02-19T22:10:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:10:13.379186+0000 mon.smithi099 (mon.0) 788 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:10:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:10:13.699154+0000 mon.smithi099 (mon.0) 789 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:10:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:10:13.699837+0000 mon.smithi099 (mon.0) 790 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:10:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:10:13.704327+0000 mon.smithi099 (mon.0) 791 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:10:14.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:12.536915+0000 mgr.smithi099.zfglya (mgr.14180) 614 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 193 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.4 MiB/s wr, 196 op/s 2024-02-19T22:10:14.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:10:13.379186+0000 mon.smithi099 (mon.0) 788 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:10:14.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:10:13.699154+0000 mon.smithi099 (mon.0) 789 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:10:14.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:10:13.699837+0000 mon.smithi099 (mon.0) 790 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:10:14.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:10:13.704327+0000 mon.smithi099 (mon.0) 791 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:10:14.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1922836 16.97 MB/sec execute 499 sec latency 33.181 ms 2024-02-19T22:10:14.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1025475 8.85 MB/sec execute 503 sec latency 10.936 ms 2024-02-19T22:10:15.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1923740 16.94 MB/sec execute 500 sec latency 572.278 ms 2024-02-19T22:10:15.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1027064 8.86 MB/sec execute 504 sec latency 18.025 ms 2024-02-19T22:10:16.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:14.537320+0000 mgr.smithi099.zfglya (mgr.14180) 615 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.7 MiB/s wr, 192 op/s 2024-02-19T22:10:16.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:14.537320+0000 mgr.smithi099.zfglya (mgr.14180) 615 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.7 MiB/s wr, 192 op/s 2024-02-19T22:10:16.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1925403 16.93 MB/sec execute 501 sec latency 607.717 ms 2024-02-19T22:10:16.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1028522 8.85 MB/sec execute 505 sec latency 20.145 ms 2024-02-19T22:10:17.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1928625 16.93 MB/sec execute 502 sec latency 33.453 ms 2024-02-19T22:10:17.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1030263 8.86 MB/sec execute 506 sec latency 11.030 ms 2024-02-19T22:10:18.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:16.537790+0000 mgr.smithi099.zfglya (mgr.14180) 616 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 178 op/s 2024-02-19T22:10:18.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:16.537790+0000 mgr.smithi099.zfglya (mgr.14180) 616 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.0 MiB/s wr, 178 op/s 2024-02-19T22:10:18.628 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1931610 16.92 MB/sec execute 503 sec latency 33.652 ms 2024-02-19T22:10:18.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1031532 8.85 MB/sec execute 507 sec latency 21.139 ms 2024-02-19T22:10:19.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1934377 16.92 MB/sec execute 504 sec latency 53.487 ms 2024-02-19T22:10:19.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1033417 8.85 MB/sec execute 508 sec latency 8.541 ms 2024-02-19T22:10:20.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:18.538210+0000 mgr.smithi099.zfglya (mgr.14180) 617 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.4 KiB/s rd, 3.6 MiB/s wr, 173 op/s 2024-02-19T22:10:20.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:18.538210+0000 mgr.smithi099.zfglya (mgr.14180) 617 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.4 KiB/s rd, 3.6 MiB/s wr, 173 op/s 2024-02-19T22:10:20.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1937275 16.92 MB/sec execute 505 sec latency 31.948 ms 2024-02-19T22:10:20.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1034642 8.85 MB/sec execute 509 sec latency 14.478 ms 2024-02-19T22:10:21.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1940639 16.92 MB/sec execute 506 sec latency 54.471 ms 2024-02-19T22:10:21.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1036233 8.84 MB/sec execute 510 sec latency 8.258 ms 2024-02-19T22:10:22.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:20.538658+0000 mgr.smithi099.zfglya (mgr.14180) 618 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 180 op/s 2024-02-19T22:10:22.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:20.538658+0000 mgr.smithi099.zfglya (mgr.14180) 618 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.1 MiB/s wr, 180 op/s 2024-02-19T22:10:22.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1944065 16.93 MB/sec execute 507 sec latency 242.264 ms 2024-02-19T22:10:22.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1037780 8.85 MB/sec execute 511 sec latency 13.009 ms 2024-02-19T22:10:23.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1947598 16.93 MB/sec execute 508 sec latency 27.183 ms 2024-02-19T22:10:23.787 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1039315 8.84 MB/sec execute 512 sec latency 23.269 ms 2024-02-19T22:10:24.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:22.539089+0000 mgr.smithi099.zfglya (mgr.14180) 619 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.3 KiB/s rd, 3.8 MiB/s wr, 213 op/s 2024-02-19T22:10:24.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:22.539089+0000 mgr.smithi099.zfglya (mgr.14180) 619 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.3 KiB/s rd, 3.8 MiB/s wr, 213 op/s 2024-02-19T22:10:24.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1950221 16.92 MB/sec execute 509 sec latency 52.991 ms 2024-02-19T22:10:24.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1041101 8.85 MB/sec execute 513 sec latency 8.579 ms 2024-02-19T22:10:25.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1953387 16.93 MB/sec execute 510 sec latency 33.230 ms 2024-02-19T22:10:25.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1042533 8.84 MB/sec execute 514 sec latency 35.697 ms 2024-02-19T22:10:26.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:24.539485+0000 mgr.smithi099.zfglya (mgr.14180) 620 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.2 KiB/s rd, 3.5 MiB/s wr, 160 op/s 2024-02-19T22:10:26.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:24.539485+0000 mgr.smithi099.zfglya (mgr.14180) 620 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.2 KiB/s rd, 3.5 MiB/s wr, 160 op/s 2024-02-19T22:10:26.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1956426 16.92 MB/sec execute 511 sec latency 27.570 ms 2024-02-19T22:10:26.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1044279 8.85 MB/sec execute 515 sec latency 10.729 ms 2024-02-19T22:10:27.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1958485 16.91 MB/sec execute 512 sec latency 159.997 ms 2024-02-19T22:10:27.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1045803 8.85 MB/sec execute 516 sec latency 9.527 ms 2024-02-19T22:10:28.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:26.539938+0000 mgr.smithi099.zfglya (mgr.14180) 621 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 172 op/s 2024-02-19T22:10:28.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:26.539938+0000 mgr.smithi099.zfglya (mgr.14180) 621 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.2 KiB/s rd, 4.0 MiB/s wr, 172 op/s 2024-02-19T22:10:28.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1961911 16.91 MB/sec execute 513 sec latency 41.546 ms 2024-02-19T22:10:28.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1047701 8.85 MB/sec execute 517 sec latency 15.002 ms 2024-02-19T22:10:29.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1965394 16.92 MB/sec execute 514 sec latency 52.364 ms 2024-02-19T22:10:29.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1048994 8.84 MB/sec execute 518 sec latency 23.697 ms 2024-02-19T22:10:30.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:28.540425+0000 mgr.smithi099.zfglya (mgr.14180) 622 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.0 KiB/s rd, 3.8 MiB/s wr, 204 op/s 2024-02-19T22:10:30.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:28.540425+0000 mgr.smithi099.zfglya (mgr.14180) 622 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.0 KiB/s rd, 3.8 MiB/s wr, 204 op/s 2024-02-19T22:10:30.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1968931 16.92 MB/sec execute 515 sec latency 56.358 ms 2024-02-19T22:10:30.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1050722 8.84 MB/sec execute 519 sec latency 7.963 ms 2024-02-19T22:10:31.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1972427 16.93 MB/sec execute 516 sec latency 33.703 ms 2024-02-19T22:10:31.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1052250 8.84 MB/sec execute 520 sec latency 13.737 ms 2024-02-19T22:10:32.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:30.540915+0000 mgr.smithi099.zfglya (mgr.14180) 623 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 KiB/s rd, 4.1 MiB/s wr, 176 op/s 2024-02-19T22:10:32.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:30.540915+0000 mgr.smithi099.zfglya (mgr.14180) 623 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.3 KiB/s rd, 4.1 MiB/s wr, 176 op/s 2024-02-19T22:10:32.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1975038 16.92 MB/sec execute 517 sec latency 83.422 ms 2024-02-19T22:10:32.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1053957 8.84 MB/sec execute 521 sec latency 12.121 ms 2024-02-19T22:10:33.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1978265 16.92 MB/sec execute 518 sec latency 33.714 ms 2024-02-19T22:10:33.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1055599 8.85 MB/sec execute 522 sec latency 7.048 ms 2024-02-19T22:10:34.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:32.541431+0000 mgr.smithi099.zfglya (mgr.14180) 624 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.6 MiB/s wr, 199 op/s 2024-02-19T22:10:34.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:32.541431+0000 mgr.smithi099.zfglya (mgr.14180) 624 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.6 MiB/s wr, 199 op/s 2024-02-19T22:10:34.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1981254 16.92 MB/sec execute 519 sec latency 27.637 ms 2024-02-19T22:10:34.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1057319 8.84 MB/sec execute 523 sec latency 20.892 ms 2024-02-19T22:10:35.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1984268 16.92 MB/sec execute 520 sec latency 58.463 ms 2024-02-19T22:10:35.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1059002 8.85 MB/sec execute 524 sec latency 11.459 ms 2024-02-19T22:10:36.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:34.541872+0000 mgr.smithi099.zfglya (mgr.14180) 625 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.6 MiB/s wr, 174 op/s 2024-02-19T22:10:36.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:34.541872+0000 mgr.smithi099.zfglya (mgr.14180) 625 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.6 MiB/s wr, 174 op/s 2024-02-19T22:10:36.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1987564 16.92 MB/sec execute 521 sec latency 27.917 ms 2024-02-19T22:10:36.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1060585 8.84 MB/sec execute 525 sec latency 16.055 ms 2024-02-19T22:10:37.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1990395 16.92 MB/sec execute 522 sec latency 41.595 ms 2024-02-19T22:10:37.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1062392 8.85 MB/sec execute 526 sec latency 7.924 ms 2024-02-19T22:10:38.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:36.542335+0000 mgr.smithi099.zfglya (mgr.14180) 626 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 192 op/s 2024-02-19T22:10:38.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:36.542335+0000 mgr.smithi099.zfglya (mgr.14180) 626 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 192 op/s 2024-02-19T22:10:38.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1993825 16.92 MB/sec execute 523 sec latency 48.276 ms 2024-02-19T22:10:38.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1063815 8.84 MB/sec execute 527 sec latency 14.160 ms 2024-02-19T22:10:39.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 1997362 16.92 MB/sec execute 524 sec latency 32.053 ms 2024-02-19T22:10:39.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1065553 8.85 MB/sec execute 528 sec latency 10.948 ms 2024-02-19T22:10:40.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:38.542757+0000 mgr.smithi099.zfglya (mgr.14180) 627 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.9 MiB/s wr, 219 op/s 2024-02-19T22:10:40.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:38.542757+0000 mgr.smithi099.zfglya (mgr.14180) 627 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.9 MiB/s wr, 219 op/s 2024-02-19T22:10:40.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2000848 16.93 MB/sec execute 525 sec latency 44.920 ms 2024-02-19T22:10:40.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1066975 8.84 MB/sec execute 529 sec latency 8.106 ms 2024-02-19T22:10:41.629 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2004337 16.93 MB/sec execute 526 sec latency 33.294 ms 2024-02-19T22:10:41.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1068933 8.85 MB/sec execute 530 sec latency 6.357 ms 2024-02-19T22:10:42.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:40.543198+0000 mgr.smithi099.zfglya (mgr.14180) 628 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.4 MiB/s wr, 192 op/s 2024-02-19T22:10:42.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:40.543198+0000 mgr.smithi099.zfglya (mgr.14180) 628 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 6.0 KiB/s rd, 4.4 MiB/s wr, 192 op/s 2024-02-19T22:10:42.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2007877 16.94 MB/sec execute 527 sec latency 27.817 ms 2024-02-19T22:10:42.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1070182 8.84 MB/sec execute 531 sec latency 23.078 ms 2024-02-19T22:10:43.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2010491 16.93 MB/sec execute 528 sec latency 48.442 ms 2024-02-19T22:10:43.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1071858 8.84 MB/sec execute 532 sec latency 12.895 ms 2024-02-19T22:10:44.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:42.543622+0000 mgr.smithi099.zfglya (mgr.14180) 629 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 182 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.8 MiB/s wr, 213 op/s 2024-02-19T22:10:44.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:42.543622+0000 mgr.smithi099.zfglya (mgr.14180) 629 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 182 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 KiB/s rd, 3.8 MiB/s wr, 213 op/s 2024-02-19T22:10:44.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2013720 16.93 MB/sec execute 529 sec latency 33.577 ms 2024-02-19T22:10:44.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1073448 8.84 MB/sec execute 533 sec latency 15.810 ms 2024-02-19T22:10:45.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2016706 16.93 MB/sec execute 530 sec latency 27.672 ms 2024-02-19T22:10:45.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1075053 8.84 MB/sec execute 534 sec latency 9.338 ms 2024-02-19T22:10:46.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:44.544148+0000 mgr.smithi099.zfglya (mgr.14180) 630 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 3.8 MiB/s wr, 178 op/s 2024-02-19T22:10:46.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:44.544148+0000 mgr.smithi099.zfglya (mgr.14180) 630 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 183 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 3.8 MiB/s wr, 178 op/s 2024-02-19T22:10:46.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2019722 16.93 MB/sec execute 531 sec latency 49.832 ms 2024-02-19T22:10:46.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1076639 8.84 MB/sec execute 535 sec latency 18.419 ms 2024-02-19T22:10:47.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2022126 16.92 MB/sec execute 532 sec latency 222.020 ms 2024-02-19T22:10:47.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1077974 8.84 MB/sec execute 536 sec latency 13.160 ms 2024-02-19T22:10:48.449 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:46.544553+0000 mgr.smithi099.zfglya (mgr.14180) 631 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 173 op/s 2024-02-19T22:10:48.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:46.544553+0000 mgr.smithi099.zfglya (mgr.14180) 631 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 173 op/s 2024-02-19T22:10:48.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2022305 16.89 MB/sec execute 533 sec latency 341.943 ms 2024-02-19T22:10:48.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1079663 8.84 MB/sec execute 537 sec latency 5.698 ms 2024-02-19T22:10:49.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2025810 16.89 MB/sec execute 534 sec latency 27.309 ms 2024-02-19T22:10:49.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1080956 8.83 MB/sec execute 538 sec latency 18.907 ms 2024-02-19T22:10:50.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:48.545114+0000 mgr.smithi099.zfglya (mgr.14180) 632 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.8 MiB/s wr, 197 op/s 2024-02-19T22:10:50.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:48.545114+0000 mgr.smithi099.zfglya (mgr.14180) 632 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.8 MiB/s wr, 197 op/s 2024-02-19T22:10:50.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2029280 16.90 MB/sec execute 535 sec latency 33.628 ms 2024-02-19T22:10:50.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1082628 8.84 MB/sec execute 539 sec latency 16.208 ms 2024-02-19T22:10:51.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2032759 16.90 MB/sec execute 536 sec latency 53.223 ms 2024-02-19T22:10:51.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1084033 8.83 MB/sec execute 540 sec latency 14.851 ms 2024-02-19T22:10:52.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:50.545606+0000 mgr.smithi099.zfglya (mgr.14180) 633 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 182 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 4.1 MiB/s wr, 169 op/s 2024-02-19T22:10:52.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:50.545606+0000 mgr.smithi099.zfglya (mgr.14180) 633 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 182 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 4.1 MiB/s wr, 169 op/s 2024-02-19T22:10:52.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2036299 16.91 MB/sec execute 537 sec latency 27.240 ms 2024-02-19T22:10:52.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1085599 8.83 MB/sec execute 541 sec latency 9.973 ms 2024-02-19T22:10:53.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2039787 16.91 MB/sec execute 538 sec latency 77.646 ms 2024-02-19T22:10:53.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1087249 8.84 MB/sec execute 542 sec latency 7.430 ms 2024-02-19T22:10:54.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:52.546094+0000 mgr.smithi099.zfglya (mgr.14180) 634 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.4 KiB/s rd, 3.4 MiB/s wr, 194 op/s 2024-02-19T22:10:54.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:52.546094+0000 mgr.smithi099.zfglya (mgr.14180) 634 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.4 KiB/s rd, 3.4 MiB/s wr, 194 op/s 2024-02-19T22:10:54.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2042440 16.90 MB/sec execute 539 sec latency 50.088 ms 2024-02-19T22:10:54.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1088584 8.83 MB/sec execute 543 sec latency 14.867 ms 2024-02-19T22:10:55.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2045947 16.91 MB/sec execute 540 sec latency 41.784 ms 2024-02-19T22:10:55.788 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1090297 8.83 MB/sec execute 544 sec latency 11.221 ms 2024-02-19T22:10:56.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:54.546497+0000 mgr.smithi099.zfglya (mgr.14180) 635 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.4 MiB/s wr, 167 op/s 2024-02-19T22:10:56.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:54.546497+0000 mgr.smithi099.zfglya (mgr.14180) 635 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.4 MiB/s wr, 167 op/s 2024-02-19T22:10:56.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2049017 16.91 MB/sec execute 541 sec latency 55.011 ms 2024-02-19T22:10:56.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1091605 8.83 MB/sec execute 545 sec latency 18.013 ms 2024-02-19T22:10:57.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2052176 16.90 MB/sec execute 542 sec latency 27.556 ms 2024-02-19T22:10:57.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1093288 8.83 MB/sec execute 546 sec latency 8.034 ms 2024-02-19T22:10:58.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:10:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:56.546978+0000 mgr.smithi099.zfglya (mgr.14180) 636 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.9 MiB/s wr, 180 op/s 2024-02-19T22:10:58.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:10:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:56.546978+0000 mgr.smithi099.zfglya (mgr.14180) 636 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.9 MiB/s wr, 180 op/s 2024-02-19T22:10:58.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2054979 16.90 MB/sec execute 543 sec latency 72.951 ms 2024-02-19T22:10:58.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1094680 8.83 MB/sec execute 547 sec latency 20.367 ms 2024-02-19T22:10:59.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2057773 16.90 MB/sec execute 544 sec latency 91.685 ms 2024-02-19T22:10:59.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1096237 8.82 MB/sec execute 548 sec latency 24.745 ms 2024-02-19T22:11:00.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:10:58.547441+0000 mgr.smithi099.zfglya (mgr.14180) 637 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.7 MiB/s wr, 213 op/s 2024-02-19T22:11:00.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:10:58.547441+0000 mgr.smithi099.zfglya (mgr.14180) 637 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.7 MiB/s wr, 213 op/s 2024-02-19T22:11:00.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2061237 16.90 MB/sec execute 545 sec latency 33.709 ms 2024-02-19T22:11:00.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1097910 8.83 MB/sec execute 549 sec latency 14.826 ms 2024-02-19T22:11:01.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2064722 16.91 MB/sec execute 546 sec latency 31.616 ms 2024-02-19T22:11:01.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1099305 8.82 MB/sec execute 550 sec latency 31.338 ms 2024-02-19T22:11:02.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:00.547930+0000 mgr.smithi099.zfglya (mgr.14180) 638 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.9 MiB/s wr, 180 op/s 2024-02-19T22:11:02.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:00.547930+0000 mgr.smithi099.zfglya (mgr.14180) 638 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.9 MiB/s wr, 180 op/s 2024-02-19T22:11:02.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2068212 16.91 MB/sec execute 547 sec latency 41.736 ms 2024-02-19T22:11:02.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1100992 8.82 MB/sec execute 551 sec latency 12.922 ms 2024-02-19T22:11:03.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2071754 16.92 MB/sec execute 548 sec latency 27.905 ms 2024-02-19T22:11:03.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1102365 8.82 MB/sec execute 552 sec latency 12.034 ms 2024-02-19T22:11:04.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:02.548401+0000 mgr.smithi099.zfglya (mgr.14180) 639 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.5 KiB/s rd, 3.5 MiB/s wr, 184 op/s 2024-02-19T22:11:04.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:02.548401+0000 mgr.smithi099.zfglya (mgr.14180) 639 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.5 KiB/s rd, 3.5 MiB/s wr, 184 op/s 2024-02-19T22:11:04.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2074365 16.91 MB/sec execute 549 sec latency 49.794 ms 2024-02-19T22:11:04.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1104131 8.82 MB/sec execute 553 sec latency 15.793 ms 2024-02-19T22:11:05.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2077534 16.91 MB/sec execute 550 sec latency 27.205 ms 2024-02-19T22:11:05.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1105484 8.82 MB/sec execute 554 sec latency 9.108 ms 2024-02-19T22:11:06.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:04.548842+0000 mgr.smithi099.zfglya (mgr.14180) 640 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.5 MiB/s wr, 154 op/s 2024-02-19T22:11:06.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:04.548842+0000 mgr.smithi099.zfglya (mgr.14180) 640 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 3.5 MiB/s wr, 154 op/s 2024-02-19T22:11:06.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2080580 16.91 MB/sec execute 551 sec latency 26.928 ms 2024-02-19T22:11:06.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1107092 8.81 MB/sec execute 555 sec latency 23.424 ms 2024-02-19T22:11:07.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2083595 16.91 MB/sec execute 552 sec latency 49.603 ms 2024-02-19T22:11:07.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1108655 8.82 MB/sec execute 556 sec latency 23.318 ms 2024-02-19T22:11:08.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:06.549295+0000 mgr.smithi099.zfglya (mgr.14180) 641 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 200 op/s 2024-02-19T22:11:08.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:06.549295+0000 mgr.smithi099.zfglya (mgr.14180) 641 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.7 KiB/s rd, 4.3 MiB/s wr, 200 op/s 2024-02-19T22:11:08.630 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2086248 16.90 MB/sec execute 553 sec latency 36.092 ms 2024-02-19T22:11:08.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1110107 8.81 MB/sec execute 557 sec latency 16.888 ms 2024-02-19T22:11:09.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2089720 16.91 MB/sec execute 554 sec latency 27.686 ms 2024-02-19T22:11:09.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1111854 8.82 MB/sec execute 558 sec latency 10.884 ms 2024-02-19T22:11:10.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:08.549772+0000 mgr.smithi099.zfglya (mgr.14180) 642 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 185 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.4 KiB/s rd, 3.8 MiB/s wr, 189 op/s 2024-02-19T22:11:10.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:08.549772+0000 mgr.smithi099.zfglya (mgr.14180) 642 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 185 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.4 KiB/s rd, 3.8 MiB/s wr, 189 op/s 2024-02-19T22:11:10.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2093153 16.91 MB/sec execute 555 sec latency 48.946 ms 2024-02-19T22:11:10.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1113071 8.81 MB/sec execute 559 sec latency 23.390 ms 2024-02-19T22:11:11.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2096633 16.91 MB/sec execute 556 sec latency 33.485 ms 2024-02-19T22:11:11.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1114960 8.82 MB/sec execute 560 sec latency 12.397 ms 2024-02-19T22:11:12.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:10.550225+0000 mgr.smithi099.zfglya (mgr.14180) 643 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 186 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 4.1 MiB/s wr, 173 op/s 2024-02-19T22:11:12.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:10.550225+0000 mgr.smithi099.zfglya (mgr.14180) 643 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 186 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 4.1 MiB/s wr, 173 op/s 2024-02-19T22:11:12.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2100171 16.92 MB/sec execute 557 sec latency 41.314 ms 2024-02-19T22:11:12.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1116150 8.81 MB/sec execute 561 sec latency 28.200 ms 2024-02-19T22:11:13.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2103662 16.92 MB/sec execute 558 sec latency 50.065 ms 2024-02-19T22:11:13.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1117739 8.81 MB/sec execute 562 sec latency 8.657 ms 2024-02-19T22:11:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:12.550692+0000 mgr.smithi099.zfglya (mgr.14180) 644 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 183 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.5 MiB/s wr, 179 op/s 2024-02-19T22:11:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:11:13.709951+0000 mon.smithi099 (mon.0) 792 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:11:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:11:14.044943+0000 mon.smithi099 (mon.0) 793 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:11:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:11:14.045775+0000 mon.smithi099 (mon.0) 794 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:11:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:11:14.049893+0000 mon.smithi099 (mon.0) 795 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:11:14.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:12.550692+0000 mgr.smithi099.zfglya (mgr.14180) 644 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 183 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.5 MiB/s wr, 179 op/s 2024-02-19T22:11:14.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:11:13.709951+0000 mon.smithi099 (mon.0) 792 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:11:14.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:11:14.044943+0000 mon.smithi099 (mon.0) 793 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:11:14.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:11:14.045775+0000 mon.smithi099 (mon.0) 794 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:11:14.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:11:14.049893+0000 mon.smithi099 (mon.0) 795 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:11:14.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2106315 16.92 MB/sec execute 559 sec latency 34.678 ms 2024-02-19T22:11:14.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1119251 8.81 MB/sec execute 563 sec latency 19.919 ms 2024-02-19T22:11:15.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2108945 16.91 MB/sec execute 560 sec latency 141.705 ms 2024-02-19T22:11:15.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1120727 8.81 MB/sec execute 564 sec latency 14.968 ms 2024-02-19T22:11:16.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:14.551089+0000 mgr.smithi099.zfglya (mgr.14180) 645 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 185 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 3.6 MiB/s wr, 165 op/s 2024-02-19T22:11:16.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:14.551089+0000 mgr.smithi099.zfglya (mgr.14180) 645 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 185 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 3.6 MiB/s wr, 165 op/s 2024-02-19T22:11:16.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2111963 16.91 MB/sec execute 561 sec latency 28.032 ms 2024-02-19T22:11:16.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1122481 8.81 MB/sec execute 565 sec latency 14.455 ms 2024-02-19T22:11:17.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2115256 16.91 MB/sec execute 562 sec latency 31.303 ms 2024-02-19T22:11:17.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1123804 8.81 MB/sec execute 566 sec latency 12.343 ms 2024-02-19T22:11:18.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:16.551518+0000 mgr.smithi099.zfglya (mgr.14180) 646 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 4.1 MiB/s wr, 198 op/s 2024-02-19T22:11:18.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:16.551518+0000 mgr.smithi099.zfglya (mgr.14180) 646 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 4.1 MiB/s wr, 198 op/s 2024-02-19T22:11:18.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2118047 16.91 MB/sec execute 563 sec latency 53.467 ms 2024-02-19T22:11:18.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1125679 8.81 MB/sec execute 567 sec latency 14.859 ms 2024-02-19T22:11:19.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2120455 16.90 MB/sec execute 564 sec latency 436.540 ms 2024-02-19T22:11:19.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1126857 8.80 MB/sec execute 568 sec latency 13.921 ms 2024-02-19T22:11:20.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:18.551967+0000 mgr.smithi099.zfglya (mgr.14180) 647 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 184 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.3 MiB/s wr, 151 op/s 2024-02-19T22:11:20.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:18.551967+0000 mgr.smithi099.zfglya (mgr.14180) 647 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 184 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.3 MiB/s wr, 151 op/s 2024-02-19T22:11:20.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2121516 16.88 MB/sec execute 565 sec latency 479.965 ms 2024-02-19T22:11:20.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1128464 8.80 MB/sec execute 569 sec latency 5.911 ms 2024-02-19T22:11:21.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2124991 16.88 MB/sec execute 566 sec latency 45.430 ms 2024-02-19T22:11:21.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1129997 8.80 MB/sec execute 570 sec latency 16.658 ms 2024-02-19T22:11:22.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:20.552417+0000 mgr.smithi099.zfglya (mgr.14180) 648 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 187 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 4.1 MiB/s wr, 194 op/s 2024-02-19T22:11:22.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:20.552417+0000 mgr.smithi099.zfglya (mgr.14180) 648 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 187 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 5.4 KiB/s rd, 4.1 MiB/s wr, 194 op/s 2024-02-19T22:11:22.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2128488 16.89 MB/sec execute 567 sec latency 33.297 ms 2024-02-19T22:11:22.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1131658 8.80 MB/sec execute 571 sec latency 35.516 ms 2024-02-19T22:11:23.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2132026 16.89 MB/sec execute 568 sec latency 46.458 ms 2024-02-19T22:11:23.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1133419 8.81 MB/sec execute 572 sec latency 16.225 ms 2024-02-19T22:11:24.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:22.552844+0000 mgr.smithi099.zfglya (mgr.14180) 649 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.3 MiB/s wr, 167 op/s 2024-02-19T22:11:24.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:22.552844+0000 mgr.smithi099.zfglya (mgr.14180) 649 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 184 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.2 KiB/s rd, 3.3 MiB/s wr, 167 op/s 2024-02-19T22:11:24.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2134545 16.89 MB/sec execute 569 sec latency 33.262 ms 2024-02-19T22:11:24.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1134942 8.80 MB/sec execute 573 sec latency 24.789 ms 2024-02-19T22:11:25.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2137244 16.88 MB/sec execute 570 sec latency 99.767 ms 2024-02-19T22:11:25.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1136763 8.81 MB/sec execute 574 sec latency 11.487 ms 2024-02-19T22:11:26.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:24.553318+0000 mgr.smithi099.zfglya (mgr.14180) 650 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 3.6 MiB/s wr, 173 op/s 2024-02-19T22:11:26.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:24.553318+0000 mgr.smithi099.zfglya (mgr.14180) 650 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 3.6 MiB/s wr, 173 op/s 2024-02-19T22:11:26.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2140331 16.88 MB/sec execute 571 sec latency 41.738 ms 2024-02-19T22:11:26.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1138194 8.80 MB/sec execute 575 sec latency 21.534 ms 2024-02-19T22:11:27.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2142981 16.88 MB/sec execute 572 sec latency 33.769 ms 2024-02-19T22:11:27.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1139986 8.80 MB/sec execute 576 sec latency 11.117 ms 2024-02-19T22:11:28.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:26.553748+0000 mgr.smithi099.zfglya (mgr.14180) 651 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 3.9 MiB/s wr, 188 op/s 2024-02-19T22:11:28.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:26.553748+0000 mgr.smithi099.zfglya (mgr.14180) 651 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 185 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 3.9 MiB/s wr, 188 op/s 2024-02-19T22:11:28.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2146415 16.88 MB/sec execute 573 sec latency 33.217 ms 2024-02-19T22:11:28.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1141433 8.80 MB/sec execute 577 sec latency 13.649 ms 2024-02-19T22:11:29.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2149881 16.88 MB/sec execute 574 sec latency 49.459 ms 2024-02-19T22:11:29.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1143375 8.81 MB/sec execute 578 sec latency 7.125 ms 2024-02-19T22:11:30.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:28.554228+0000 mgr.smithi099.zfglya (mgr.14180) 652 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.7 MiB/s wr, 187 op/s 2024-02-19T22:11:30.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:28.554228+0000 mgr.smithi099.zfglya (mgr.14180) 652 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.7 MiB/s wr, 187 op/s 2024-02-19T22:11:30.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2153304 16.89 MB/sec execute 575 sec latency 157.758 ms 2024-02-19T22:11:30.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1144667 8.80 MB/sec execute 579 sec latency 8.571 ms 2024-02-19T22:11:31.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2155925 16.88 MB/sec execute 576 sec latency 50.919 ms 2024-02-19T22:11:31.789 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1146325 8.80 MB/sec execute 580 sec latency 18.917 ms 2024-02-19T22:11:32.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:30.554819+0000 mgr.smithi099.zfglya (mgr.14180) 653 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 197 op/s 2024-02-19T22:11:32.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:30.554819+0000 mgr.smithi099.zfglya (mgr.14180) 653 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.9 KiB/s rd, 4.3 MiB/s wr, 197 op/s 2024-02-19T22:11:32.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2159090 16.88 MB/sec execute 577 sec latency 35.667 ms 2024-02-19T22:11:32.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1147904 8.80 MB/sec execute 581 sec latency 18.058 ms 2024-02-19T22:11:33.631 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2162091 16.88 MB/sec execute 578 sec latency 33.217 ms 2024-02-19T22:11:33.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1149597 8.80 MB/sec execute 582 sec latency 17.471 ms 2024-02-19T22:11:34.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:32.555315+0000 mgr.smithi099.zfglya (mgr.14180) 654 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.6 MiB/s wr, 193 op/s 2024-02-19T22:11:34.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:32.555315+0000 mgr.smithi099.zfglya (mgr.14180) 654 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 187 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.6 MiB/s wr, 193 op/s 2024-02-19T22:11:34.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2164901 16.88 MB/sec execute 579 sec latency 61.058 ms 2024-02-19T22:11:34.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1151216 8.81 MB/sec execute 583 sec latency 16.625 ms 2024-02-19T22:11:35.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2167797 16.87 MB/sec execute 580 sec latency 50.328 ms 2024-02-19T22:11:35.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1152693 8.80 MB/sec execute 584 sec latency 32.420 ms 2024-02-19T22:11:36.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:34.555728+0000 mgr.smithi099.zfglya (mgr.14180) 655 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.8 MiB/s wr, 188 op/s 2024-02-19T22:11:36.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:34.555728+0000 mgr.smithi099.zfglya (mgr.14180) 655 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 3.8 MiB/s wr, 188 op/s 2024-02-19T22:11:36.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2171841 16.88 MB/sec execute 581 sec latency 33.351 ms 2024-02-19T22:11:36.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1154453 8.81 MB/sec execute 585 sec latency 12.246 ms 2024-02-19T22:11:37.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2174781 16.88 MB/sec execute 582 sec latency 42.427 ms 2024-02-19T22:11:37.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1155768 8.80 MB/sec execute 586 sec latency 21.965 ms 2024-02-19T22:11:38.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:36.556189+0000 mgr.smithi099.zfglya (mgr.14180) 656 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 181 op/s 2024-02-19T22:11:38.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:36.556189+0000 mgr.smithi099.zfglya (mgr.14180) 656 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.0 MiB/s wr, 181 op/s 2024-02-19T22:11:38.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2178251 16.88 MB/sec execute 583 sec latency 33.232 ms 2024-02-19T22:11:38.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1157590 8.80 MB/sec execute 587 sec latency 17.438 ms 2024-02-19T22:11:39.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2181728 16.89 MB/sec execute 584 sec latency 45.464 ms 2024-02-19T22:11:39.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1158782 8.80 MB/sec execute 588 sec latency 32.347 ms 2024-02-19T22:11:40.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:38.556642+0000 mgr.smithi099.zfglya (mgr.14180) 657 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-02-19T22:11:40.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:38.556642+0000 mgr.smithi099.zfglya (mgr.14180) 657 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 189 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.9 MiB/s wr, 203 op/s 2024-02-19T22:11:40.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2185266 16.89 MB/sec execute 585 sec latency 33.181 ms 2024-02-19T22:11:40.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1160369 8.79 MB/sec execute 589 sec latency 13.711 ms 2024-02-19T22:11:41.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2188755 16.90 MB/sec execute 586 sec latency 41.733 ms 2024-02-19T22:11:41.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1161898 8.80 MB/sec execute 590 sec latency 13.756 ms 2024-02-19T22:11:42.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:40.557125+0000 mgr.smithi099.zfglya (mgr.14180) 658 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 4.2 MiB/s wr, 194 op/s 2024-02-19T22:11:42.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2191371 16.89 MB/sec execute 587 sec latency 47.525 ms 2024-02-19T22:11:42.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:40.557125+0000 mgr.smithi099.zfglya (mgr.14180) 658 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s rd, 4.2 MiB/s wr, 194 op/s 2024-02-19T22:11:42.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1163364 8.79 MB/sec execute 591 sec latency 17.362 ms 2024-02-19T22:11:43.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2194391 16.89 MB/sec execute 588 sec latency 33.639 ms 2024-02-19T22:11:43.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1165098 8.80 MB/sec execute 592 sec latency 13.436 ms 2024-02-19T22:11:44.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:42.557581+0000 mgr.smithi099.zfglya (mgr.14180) 659 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.3 KiB/s rd, 3.5 MiB/s wr, 182 op/s 2024-02-19T22:11:44.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2197061 16.88 MB/sec execute 589 sec latency 41.664 ms 2024-02-19T22:11:44.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:42.557581+0000 mgr.smithi099.zfglya (mgr.14180) 659 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 186 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.3 KiB/s rd, 3.5 MiB/s wr, 182 op/s 2024-02-19T22:11:44.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1166510 8.79 MB/sec execute 593 sec latency 13.469 ms 2024-02-19T22:11:45.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2200354 16.89 MB/sec execute 590 sec latency 49.313 ms 2024-02-19T22:11:45.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1168334 8.80 MB/sec execute 594 sec latency 15.850 ms 2024-02-19T22:11:46.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:44.557975+0000 mgr.smithi099.zfglya (mgr.14180) 660 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.5 MiB/s wr, 175 op/s 2024-02-19T22:11:46.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2203252 16.88 MB/sec execute 591 sec latency 42.661 ms 2024-02-19T22:11:46.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:44.557975+0000 mgr.smithi099.zfglya (mgr.14180) 660 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 3.5 MiB/s wr, 175 op/s 2024-02-19T22:11:46.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1169737 8.79 MB/sec execute 595 sec latency 29.853 ms 2024-02-19T22:11:47.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2206734 16.89 MB/sec execute 592 sec latency 56.587 ms 2024-02-19T22:11:47.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1171595 8.80 MB/sec execute 596 sec latency 16.728 ms 2024-02-19T22:11:48.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:46.558636+0000 mgr.smithi099.zfglya (mgr.14180) 661 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 187 op/s 2024-02-19T22:11:48.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2210234 16.89 MB/sec execute 593 sec latency 33.246 ms 2024-02-19T22:11:48.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:46.558636+0000 mgr.smithi099.zfglya (mgr.14180) 661 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.6 KiB/s rd, 4.0 MiB/s wr, 187 op/s 2024-02-19T22:11:48.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1173047 8.79 MB/sec execute 597 sec latency 10.765 ms 2024-02-19T22:11:49.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2213741 16.89 MB/sec execute 594 sec latency 34.246 ms 2024-02-19T22:11:49.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1174730 8.79 MB/sec execute 598 sec latency 8.657 ms 2024-02-19T22:11:50.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:48.559046+0000 mgr.smithi099.zfglya (mgr.14180) 662 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.9 MiB/s wr, 215 op/s 2024-02-19T22:11:50.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2217215 16.90 MB/sec execute 595 sec latency 48.641 ms 2024-02-19T22:11:50.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:48.559046+0000 mgr.smithi099.zfglya (mgr.14180) 662 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 188 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.6 KiB/s rd, 3.9 MiB/s wr, 215 op/s 2024-02-19T22:11:50.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 1176323 8.79 MB/sec execute 599 sec latency 10.225 ms 2024-02-19T22:11:51.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2217293 16.87 MB/sec execute 596 sec latency 411.175 ms 2024-02-19T22:11:51.790 INFO:tasks.workunit.client.1.smithi138.stdout: 1 cleanup 600 sec 2024-02-19T22:11:51.963 INFO:tasks.workunit.client.1.smithi138.stdout: 0 cleanup 600 sec 2024-02-19T22:11:51.963 INFO:tasks.workunit.client.1.smithi138.stdout: 2024-02-19T22:11:51.963 INFO:tasks.workunit.client.1.smithi138.stdout: Operation Count AvgLat MaxLat 2024-02-19T22:11:51.963 INFO:tasks.workunit.client.1.smithi138.stdout: ---------------------------------------- 2024-02-19T22:11:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: NTCreateX 168186 1.150 41.210 2024-02-19T22:11:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: Close 123547 0.018 3.582 2024-02-19T22:11:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: Rename 7116 2.970 50.446 2024-02-19T22:11:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: Unlink 33964 0.921 12.194 2024-02-19T22:11:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: Deltree 4 39.447 66.686 2024-02-19T22:11:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: Mkdir 2 0.173 0.199 2024-02-19T22:11:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: Qpathinfo 152429 0.728 25.742 2024-02-19T22:11:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: Qfileinfo 26685 0.050 2.663 2024-02-19T22:11:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: Qfsinfo 27931 0.225 10.751 2024-02-19T22:11:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: Sfileinfo 13696 0.367 9.548 2024-02-19T22:11:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: Find 58889 3.289 35.688 2024-02-19T22:11:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: WriteX 83758 0.100 4.244 2024-02-19T22:11:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: ReadX 263379 0.003 0.181 2024-02-19T22:11:51.964 INFO:tasks.workunit.client.1.smithi138.stdout: LockX 546 0.193 0.446 2024-02-19T22:11:51.965 INFO:tasks.workunit.client.1.smithi138.stdout: UnlockX 546 0.145 3.101 2024-02-19T22:11:51.965 INFO:tasks.workunit.client.1.smithi138.stdout: Flush 11782 1.963 21.241 2024-02-19T22:11:51.965 INFO:tasks.workunit.client.1.smithi138.stdout: 2024-02-19T22:11:51.965 INFO:tasks.workunit.client.1.smithi138.stdout:Throughput 8.79396 MB/sec 1 clients 1 procs max_latency=50.450 ms 2024-02-19T22:11:51.965 INFO:tasks.workunit.client.1.smithi138.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-02-19T22:11:51.965 INFO:tasks.workunit.client.1.smithi138.stdout: 2024-02-19T22:11:51.965 INFO:tasks.workunit.client.1.smithi138.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-02-19T22:11:51.965 INFO:tasks.workunit.client.1.smithi138.stdout:8 of 10 processes prepared for launch 0 sec 2024-02-19T22:11:52.067 INFO:tasks.workunit.client.1.smithi138.stdout:10 of 10 processes prepared for launch 0 sec 2024-02-19T22:11:52.068 INFO:tasks.workunit.client.1.smithi138.stdout:releasing clients 2024-02-19T22:11:52.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:50.559506+0000 mgr.smithi099.zfglya (mgr.14180) 663 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 191 op/s 2024-02-19T22:11:52.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2219699 16.86 MB/sec execute 597 sec latency 311.573 ms 2024-02-19T22:11:52.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:50.559506+0000 mgr.smithi099.zfglya (mgr.14180) 663 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 190 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 4.3 MiB/s wr, 191 op/s 2024-02-19T22:11:53.065 INFO:tasks.workunit.client.1.smithi138.stdout: 10 625 210.18 MB/sec warmup 1 sec latency 29.021 ms 2024-02-19T22:11:53.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2222530 16.86 MB/sec execute 598 sec latency 48.920 ms 2024-02-19T22:11:54.065 INFO:tasks.workunit.client.1.smithi138.stdout: 10 1131 114.92 MB/sec warmup 2 sec latency 48.040 ms 2024-02-19T22:11:54.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:52.559935+0000 mgr.smithi099.zfglya (mgr.14180) 664 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.6 MiB/s wr, 172 op/s 2024-02-19T22:11:54.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 2225490 16.86 MB/sec execute 599 sec latency 33.600 ms 2024-02-19T22:11:54.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:52.559935+0000 mgr.smithi099.zfglya (mgr.14180) 664 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 191 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 3.6 MiB/s wr, 172 op/s 2024-02-19T22:11:55.065 INFO:tasks.workunit.client.1.smithi138.stdout: 10 1693 87.43 MB/sec warmup 3 sec latency 66.738 ms 2024-02-19T22:11:55.632 INFO:tasks.workunit.client.0.smithi099.stdout: 1 cleanup 600 sec 2024-02-19T22:11:55.653 INFO:tasks.workunit.client.0.smithi099.stdout: 0 cleanup 600 sec 2024-02-19T22:11:55.653 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-02-19T22:11:55.654 INFO:tasks.workunit.client.0.smithi099.stdout: Operation Count AvgLat MaxLat 2024-02-19T22:11:55.654 INFO:tasks.workunit.client.0.smithi099.stdout: ---------------------------------------- 2024-02-19T22:11:55.654 INFO:tasks.workunit.client.0.smithi099.stdout: NTCreateX 322188 0.009 3.613 2024-02-19T22:11:55.654 INFO:tasks.workunit.client.0.smithi099.stdout: Close 236654 0.001 0.041 2024-02-19T22:11:55.654 INFO:tasks.workunit.client.0.smithi099.stdout: Rename 13643 0.020 1.075 2024-02-19T22:11:55.654 INFO:tasks.workunit.client.0.smithi099.stdout: Unlink 65087 0.017 6.232 2024-02-19T22:11:55.654 INFO:tasks.workunit.client.0.smithi099.stdout: Deltree 8 1.584 3.296 2024-02-19T22:11:55.654 INFO:tasks.workunit.client.0.smithi099.stdout: Mkdir 4 0.002 0.003 2024-02-19T22:11:55.654 INFO:tasks.workunit.client.0.smithi099.stdout: Qpathinfo 291989 0.004 0.509 2024-02-19T22:11:55.654 INFO:tasks.workunit.client.0.smithi099.stdout: Qfileinfo 51147 0.001 0.026 2024-02-19T22:11:55.654 INFO:tasks.workunit.client.0.smithi099.stdout: Qfsinfo 53564 0.002 0.037 2024-02-19T22:11:55.654 INFO:tasks.workunit.client.0.smithi099.stdout: Sfileinfo 26250 0.006 0.059 2024-02-19T22:11:55.654 INFO:tasks.workunit.client.0.smithi099.stdout: Find 112910 0.015 0.125 2024-02-19T22:11:55.654 INFO:tasks.workunit.client.0.smithi099.stdout: WriteX 160584 0.012 3.653 2024-02-19T22:11:55.655 INFO:tasks.workunit.client.0.smithi099.stdout: ReadX 504936 0.002 0.990 2024-02-19T22:11:55.655 INFO:tasks.workunit.client.0.smithi099.stdout: LockX 1048 0.003 0.021 2024-02-19T22:11:55.655 INFO:tasks.workunit.client.0.smithi099.stdout: UnlockX 1048 0.001 0.009 2024-02-19T22:11:55.655 INFO:tasks.workunit.client.0.smithi099.stdout: Flush 22586 25.990 607.705 2024-02-19T22:11:55.655 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-02-19T22:11:55.655 INFO:tasks.workunit.client.0.smithi099.stdout:Throughput 16.8565 MB/sec 1 clients 1 procs max_latency=607.717 ms 2024-02-19T22:11:55.655 INFO:tasks.workunit.client.0.smithi099.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-02-19T22:11:55.655 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-02-19T22:11:55.656 INFO:tasks.workunit.client.0.smithi099.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-02-19T22:11:55.656 INFO:tasks.workunit.client.0.smithi099.stdout:8 of 10 processes prepared for launch 0 sec 2024-02-19T22:11:55.755 INFO:tasks.workunit.client.0.smithi099.stdout:10 of 10 processes prepared for launch 0 sec 2024-02-19T22:11:55.755 INFO:tasks.workunit.client.0.smithi099.stdout:releasing clients 2024-02-19T22:11:56.065 INFO:tasks.workunit.client.1.smithi138.stdout: 10 2288 68.82 MB/sec warmup 4 sec latency 64.498 ms 2024-02-19T22:11:56.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:54.560450+0000 mgr.smithi099.zfglya (mgr.14180) 665 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 236 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 7.6 MiB/s wr, 205 op/s 2024-02-19T22:11:56.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:54.560450+0000 mgr.smithi099.zfglya (mgr.14180) 665 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 236 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 7.6 MiB/s wr, 205 op/s 2024-02-19T22:11:56.755 INFO:tasks.workunit.client.0.smithi099.stdout: 10 794 214.66 MB/sec warmup 1 sec latency 93.453 ms 2024-02-19T22:11:57.065 INFO:tasks.workunit.client.1.smithi138.stdout: 10 2941 66.98 MB/sec warmup 5 sec latency 26.216 ms 2024-02-19T22:11:57.755 INFO:tasks.workunit.client.0.smithi099.stdout: 10 1884 131.86 MB/sec warmup 2 sec latency 98.538 ms 2024-02-19T22:11:58.065 INFO:tasks.workunit.client.1.smithi138.stdout: 10 3554 64.02 MB/sec warmup 6 sec latency 54.516 ms 2024-02-19T22:11:58.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:11:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:56.561027+0000 mgr.smithi099.zfglya (mgr.14180) 666 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 323 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 17 MiB/s wr, 239 op/s 2024-02-19T22:11:58.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:11:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:56.561027+0000 mgr.smithi099.zfglya (mgr.14180) 666 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 323 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 5.8 KiB/s rd, 17 MiB/s wr, 239 op/s 2024-02-19T22:11:58.755 INFO:tasks.workunit.client.0.smithi099.stdout: 10 3118 113.28 MB/sec warmup 3 sec latency 118.815 ms 2024-02-19T22:11:59.065 INFO:tasks.workunit.client.1.smithi138.stdout: 10 3990 57.24 MB/sec warmup 7 sec latency 53.745 ms 2024-02-19T22:11:59.755 INFO:tasks.workunit.client.0.smithi099.stdout: 10 4295 101.05 MB/sec warmup 4 sec latency 129.449 ms 2024-02-19T22:12:00.065 INFO:tasks.workunit.client.1.smithi138.stdout: 10 4423 50.86 MB/sec warmup 8 sec latency 96.182 ms 2024-02-19T22:12:00.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:11:58.561491+0000 mgr.smithi099.zfglya (mgr.14180) 667 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 377 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.6 KiB/s rd, 22 MiB/s wr, 338 op/s 2024-02-19T22:12:00.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:11:58.561491+0000 mgr.smithi099.zfglya (mgr.14180) 667 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 377 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.6 KiB/s rd, 22 MiB/s wr, 338 op/s 2024-02-19T22:12:00.755 INFO:tasks.workunit.client.0.smithi099.stdout: 10 4523 81.94 MB/sec warmup 5 sec latency 85.154 ms 2024-02-19T22:12:01.065 INFO:tasks.workunit.client.1.smithi138.stdout: 10 5011 50.16 MB/sec warmup 9 sec latency 61.448 ms 2024-02-19T22:12:01.755 INFO:tasks.workunit.client.0.smithi099.stdout: 10 5976 78.69 MB/sec warmup 6 sec latency 121.487 ms 2024-02-19T22:12:02.065 INFO:tasks.workunit.client.1.smithi138.stdout: 10 5464 45.53 MB/sec warmup 10 sec latency 69.267 ms 2024-02-19T22:12:02.547 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:00.561949+0000 mgr.smithi099.zfglya (mgr.14180) 668 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 389 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 6.6 KiB/s rd, 25 MiB/s wr, 385 op/s 2024-02-19T22:12:02.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:00.561949+0000 mgr.smithi099.zfglya (mgr.14180) 668 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 389 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 6.6 KiB/s rd, 25 MiB/s wr, 385 op/s 2024-02-19T22:12:02.755 INFO:tasks.workunit.client.0.smithi099.stdout: 10 6894 77.86 MB/sec warmup 7 sec latency 196.786 ms 2024-02-19T22:12:03.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 5936 42.78 MB/sec warmup 11 sec latency 74.177 ms 2024-02-19T22:12:03.755 INFO:tasks.workunit.client.0.smithi099.stdout: 10 7844 74.44 MB/sec warmup 8 sec latency 323.994 ms 2024-02-19T22:12:04.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 6570 43.92 MB/sec warmup 12 sec latency 53.997 ms 2024-02-19T22:12:04.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:02.562413+0000 mgr.smithi099.zfglya (mgr.14180) 669 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 392 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.8 KiB/s rd, 25 MiB/s wr, 437 op/s 2024-02-19T22:12:04.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:02.562413+0000 mgr.smithi099.zfglya (mgr.14180) 669 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 392 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.8 KiB/s rd, 25 MiB/s wr, 437 op/s 2024-02-19T22:12:04.755 INFO:tasks.workunit.client.0.smithi099.stdout: 10 8680 71.51 MB/sec warmup 9 sec latency 101.035 ms 2024-02-19T22:12:05.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 7156 44.36 MB/sec warmup 13 sec latency 40.465 ms 2024-02-19T22:12:05.757 INFO:tasks.workunit.client.0.smithi099.stdout: 10 9995 71.24 MB/sec warmup 10 sec latency 113.043 ms 2024-02-19T22:12:06.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 7548 42.27 MB/sec warmup 14 sec latency 78.388 ms 2024-02-19T22:12:06.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:04.562819+0000 mgr.smithi099.zfglya (mgr.14180) 670 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 390 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 15 KiB/s rd, 26 MiB/s wr, 502 op/s 2024-02-19T22:12:06.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:04.562819+0000 mgr.smithi099.zfglya (mgr.14180) 670 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 390 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 15 KiB/s rd, 26 MiB/s wr, 502 op/s 2024-02-19T22:12:06.755 INFO:tasks.workunit.client.0.smithi099.stdout: 10 11332 71.39 MB/sec warmup 11 sec latency 111.116 ms 2024-02-19T22:12:07.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 7950 39.86 MB/sec warmup 15 sec latency 71.252 ms 2024-02-19T22:12:07.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 11458 65.69 MB/sec warmup 12 sec latency 112.196 ms 2024-02-19T22:12:08.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 8475 39.50 MB/sec warmup 16 sec latency 58.646 ms 2024-02-19T22:12:08.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:06.563316+0000 mgr.smithi099.zfglya (mgr.14180) 671 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 384 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 15 KiB/s rd, 25 MiB/s wr, 522 op/s 2024-02-19T22:12:08.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:06.563316+0000 mgr.smithi099.zfglya (mgr.14180) 671 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 384 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 15 KiB/s rd, 25 MiB/s wr, 522 op/s 2024-02-19T22:12:08.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 12543 64.41 MB/sec warmup 13 sec latency 113.507 ms 2024-02-19T22:12:09.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 8898 37.97 MB/sec warmup 17 sec latency 90.119 ms 2024-02-19T22:12:09.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 13650 64.93 MB/sec warmup 14 sec latency 171.770 ms 2024-02-19T22:12:10.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 9397 36.52 MB/sec warmup 18 sec latency 84.268 ms 2024-02-19T22:12:10.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:08.563863+0000 mgr.smithi099.zfglya (mgr.14180) 672 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 394 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 22 KiB/s rd, 17 MiB/s wr, 612 op/s 2024-02-19T22:12:10.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:08.563863+0000 mgr.smithi099.zfglya (mgr.14180) 672 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 394 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 22 KiB/s rd, 17 MiB/s wr, 612 op/s 2024-02-19T22:12:10.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 14929 65.19 MB/sec warmup 15 sec latency 113.346 ms 2024-02-19T22:12:11.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 9927 37.20 MB/sec warmup 19 sec latency 61.772 ms 2024-02-19T22:12:11.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 15120 61.41 MB/sec warmup 16 sec latency 93.643 ms 2024-02-19T22:12:12.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 10509 37.27 MB/sec warmup 20 sec latency 22.946 ms 2024-02-19T22:12:12.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:10.564353+0000 mgr.smithi099.zfglya (mgr.14180) 673 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 384 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 19 KiB/s rd, 13 MiB/s wr, 560 op/s 2024-02-19T22:12:12.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:10.564353+0000 mgr.smithi099.zfglya (mgr.14180) 673 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 384 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 19 KiB/s rd, 13 MiB/s wr, 560 op/s 2024-02-19T22:12:12.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 16559 61.42 MB/sec warmup 17 sec latency 115.620 ms 2024-02-19T22:12:13.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 10994 37.20 MB/sec warmup 21 sec latency 60.237 ms 2024-02-19T22:12:13.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 17527 62.14 MB/sec warmup 18 sec latency 125.322 ms 2024-02-19T22:12:14.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 11373 35.73 MB/sec warmup 22 sec latency 69.961 ms 2024-02-19T22:12:14.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:12.564883+0000 mgr.smithi099.zfglya (mgr.14180) 674 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 384 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 19 KiB/s rd, 12 MiB/s wr, 586 op/s 2024-02-19T22:12:14.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:12:14.054966+0000 mon.smithi099 (mon.0) 796 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:12:14.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:12.564883+0000 mgr.smithi099.zfglya (mgr.14180) 674 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 384 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 19 KiB/s rd, 12 MiB/s wr, 586 op/s 2024-02-19T22:12:14.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:12:14.054966+0000 mon.smithi099 (mon.0) 796 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:12:14.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 18521 61.58 MB/sec warmup 19 sec latency 109.383 ms 2024-02-19T22:12:15.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 11733 34.90 MB/sec warmup 23 sec latency 84.570 ms 2024-02-19T22:12:15.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:12:14.343176+0000 mon.smithi099 (mon.0) 797 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:12:15.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:14.565387+0000 mgr.smithi099.zfglya (mgr.14180) 675 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 388 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 11 MiB/s wr, 575 op/s 2024-02-19T22:12:15.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:12:14.707083+0000 mon.smithi099 (mon.0) 798 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:12:15.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:12:14.707737+0000 mon.smithi099 (mon.0) 799 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:12:15.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:12:14.712752+0000 mon.smithi099 (mon.0) 800 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:12:15.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 19382 60.89 MB/sec warmup 20 sec latency 106.764 ms 2024-02-19T22:12:15.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:12:14.343176+0000 mon.smithi099 (mon.0) 797 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:12:15.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:14.565387+0000 mgr.smithi099.zfglya (mgr.14180) 675 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 388 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 11 MiB/s wr, 575 op/s 2024-02-19T22:12:15.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:12:14.707083+0000 mon.smithi099 (mon.0) 798 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:12:15.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:12:14.707737+0000 mon.smithi099 (mon.0) 799 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:12:15.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:12:14.712752+0000 mon.smithi099 (mon.0) 800 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:12:16.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 12173 34.76 MB/sec warmup 24 sec latency 113.464 ms 2024-02-19T22:12:16.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 20702 61.49 MB/sec warmup 21 sec latency 116.992 ms 2024-02-19T22:12:17.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 12558 33.51 MB/sec warmup 25 sec latency 118.748 ms 2024-02-19T22:12:17.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 22010 61.79 MB/sec warmup 22 sec latency 108.599 ms 2024-02-19T22:12:17.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:16.565967+0000 mgr.smithi099.zfglya (mgr.14180) 676 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 405 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 14 MiB/s wr, 580 op/s 2024-02-19T22:12:18.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:16.565967+0000 mgr.smithi099.zfglya (mgr.14180) 676 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 405 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 14 MiB/s wr, 580 op/s 2024-02-19T22:12:18.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 13059 32.85 MB/sec warmup 26 sec latency 71.523 ms 2024-02-19T22:12:18.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 22211 59.32 MB/sec warmup 23 sec latency 85.307 ms 2024-02-19T22:12:19.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 13793 33.91 MB/sec warmup 27 sec latency 56.567 ms 2024-02-19T22:12:19.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 23671 59.44 MB/sec warmup 24 sec latency 117.184 ms 2024-02-19T22:12:19.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:18.566541+0000 mgr.smithi099.zfglya (mgr.14180) 677 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 397 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 607 op/s 2024-02-19T22:12:20.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:18.566541+0000 mgr.smithi099.zfglya (mgr.14180) 677 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 397 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 607 op/s 2024-02-19T22:12:20.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 14340 34.39 MB/sec warmup 28 sec latency 39.496 ms 2024-02-19T22:12:20.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 24642 60.06 MB/sec warmup 25 sec latency 146.687 ms 2024-02-19T22:12:21.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 14704 33.60 MB/sec warmup 29 sec latency 47.267 ms 2024-02-19T22:12:21.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 25615 59.70 MB/sec warmup 26 sec latency 101.562 ms 2024-02-19T22:12:21.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:20.567026+0000 mgr.smithi099.zfglya (mgr.14180) 678 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 389 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 513 op/s 2024-02-19T22:12:22.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:20.567026+0000 mgr.smithi099.zfglya (mgr.14180) 678 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 389 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 513 op/s 2024-02-19T22:12:22.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 15078 32.73 MB/sec warmup 30 sec latency 68.513 ms 2024-02-19T22:12:22.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 25867 57.71 MB/sec warmup 27 sec latency 112.091 ms 2024-02-19T22:12:23.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 15520 32.41 MB/sec warmup 31 sec latency 69.196 ms 2024-02-19T22:12:23.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 27353 58.08 MB/sec warmup 28 sec latency 212.905 ms 2024-02-19T22:12:23.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:22.567481+0000 mgr.smithi099.zfglya (mgr.14180) 679 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 394 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 550 op/s 2024-02-19T22:12:24.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:22.567481+0000 mgr.smithi099.zfglya (mgr.14180) 679 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 394 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 550 op/s 2024-02-19T22:12:24.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 15946 32.11 MB/sec warmup 32 sec latency 126.207 ms 2024-02-19T22:12:24.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 27732 57.51 MB/sec warmup 29 sec latency 632.097 ms 2024-02-19T22:12:25.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 16536 31.63 MB/sec warmup 33 sec latency 59.807 ms 2024-02-19T22:12:25.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 27853 55.81 MB/sec warmup 30 sec latency 732.799 ms 2024-02-19T22:12:26.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 17211 32.42 MB/sec warmup 34 sec latency 62.387 ms 2024-02-19T22:12:26.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:24.567943+0000 mgr.smithi099.zfglya (mgr.14180) 680 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 400 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 11 MiB/s wr, 492 op/s 2024-02-19T22:12:26.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:24.567943+0000 mgr.smithi099.zfglya (mgr.14180) 680 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 400 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 11 MiB/s wr, 492 op/s 2024-02-19T22:12:26.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 28127 54.46 MB/sec warmup 31 sec latency 593.519 ms 2024-02-19T22:12:27.066 INFO:tasks.workunit.client.1.smithi138.stdout: 10 17824 32.92 MB/sec warmup 35 sec latency 40.367 ms 2024-02-19T22:12:27.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 28189 52.90 MB/sec warmup 32 sec latency 510.689 ms 2024-02-19T22:12:28.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 18233 32.38 MB/sec warmup 36 sec latency 61.692 ms 2024-02-19T22:12:28.291 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:26.568627+0000 mgr.smithi099.zfglya (mgr.14180) 681 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 395 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 12 MiB/s wr, 544 op/s 2024-02-19T22:12:28.452 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:26.568627+0000 mgr.smithi099.zfglya (mgr.14180) 681 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 395 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 12 MiB/s wr, 544 op/s 2024-02-19T22:12:28.756 INFO:tasks.workunit.client.0.smithi099.stdout: 10 28739 52.19 MB/sec warmup 33 sec latency 525.126 ms 2024-02-19T22:12:29.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 18695 31.76 MB/sec warmup 37 sec latency 58.000 ms 2024-02-19T22:12:29.758 INFO:tasks.workunit.client.0.smithi099.stdout: 10 29096 51.23 MB/sec warmup 34 sec latency 512.730 ms 2024-02-19T22:12:30.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 19023 31.38 MB/sec warmup 38 sec latency 95.980 ms 2024-02-19T22:12:30.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:28.569194+0000 mgr.smithi099.zfglya (mgr.14180) 682 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 393 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 587 op/s 2024-02-19T22:12:30.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:28.569194+0000 mgr.smithi099.zfglya (mgr.14180) 682 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 393 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 587 op/s 2024-02-19T22:12:30.758 INFO:tasks.workunit.client.0.smithi099.stdout: 10 29152 49.80 MB/sec warmup 35 sec latency 453.599 ms 2024-02-19T22:12:31.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 19629 31.31 MB/sec warmup 39 sec latency 30.933 ms 2024-02-19T22:12:31.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 29407 48.59 MB/sec warmup 36 sec latency 85.526 ms 2024-02-19T22:12:32.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 20189 31.01 MB/sec warmup 40 sec latency 96.658 ms 2024-02-19T22:12:32.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:30.569719+0000 mgr.smithi099.zfglya (mgr.14180) 683 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 402 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 14 MiB/s wr, 605 op/s 2024-02-19T22:12:32.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:30.569719+0000 mgr.smithi099.zfglya (mgr.14180) 683 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 402 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 14 MiB/s wr, 605 op/s 2024-02-19T22:12:32.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 31183 49.99 MB/sec warmup 37 sec latency 120.467 ms 2024-02-19T22:12:33.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 20847 31.60 MB/sec warmup 41 sec latency 51.511 ms 2024-02-19T22:12:33.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 32647 50.87 MB/sec warmup 38 sec latency 119.852 ms 2024-02-19T22:12:34.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 21435 32.01 MB/sec warmup 42 sec latency 43.317 ms 2024-02-19T22:12:34.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:32.570173+0000 mgr.smithi099.zfglya (mgr.14180) 684 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 397 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 13 MiB/s wr, 616 op/s 2024-02-19T22:12:34.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:32.570173+0000 mgr.smithi099.zfglya (mgr.14180) 684 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 397 MiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 13 MiB/s wr, 616 op/s 2024-02-19T22:12:34.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 32819 49.67 MB/sec warmup 39 sec latency 100.760 ms 2024-02-19T22:12:35.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 21847 31.58 MB/sec warmup 43 sec latency 71.675 ms 2024-02-19T22:12:35.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 33854 49.62 MB/sec warmup 40 sec latency 342.663 ms 2024-02-19T22:12:36.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 22319 31.15 MB/sec warmup 44 sec latency 62.685 ms 2024-02-19T22:12:36.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:34.570689+0000 mgr.smithi099.zfglya (mgr.14180) 685 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 396 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 11 MiB/s wr, 580 op/s 2024-02-19T22:12:36.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:34.570689+0000 mgr.smithi099.zfglya (mgr.14180) 685 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 396 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 11 MiB/s wr, 580 op/s 2024-02-19T22:12:36.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 35159 50.34 MB/sec warmup 41 sec latency 125.351 ms 2024-02-19T22:12:37.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 22886 31.31 MB/sec warmup 45 sec latency 85.952 ms 2024-02-19T22:12:37.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 36247 50.61 MB/sec warmup 42 sec latency 99.000 ms 2024-02-19T22:12:38.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 23305 30.75 MB/sec warmup 46 sec latency 124.695 ms 2024-02-19T22:12:38.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:36.571329+0000 mgr.smithi099.zfglya (mgr.14180) 686 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 408 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 13 MiB/s wr, 568 op/s 2024-02-19T22:12:38.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:36.571329+0000 mgr.smithi099.zfglya (mgr.14180) 686 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 408 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 13 MiB/s wr, 568 op/s 2024-02-19T22:12:38.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 36499 49.57 MB/sec warmup 43 sec latency 107.994 ms 2024-02-19T22:12:39.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 23827 30.58 MB/sec warmup 47 sec latency 84.542 ms 2024-02-19T22:12:39.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 38158 50.43 MB/sec warmup 44 sec latency 111.114 ms 2024-02-19T22:12:40.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 24580 31.20 MB/sec warmup 48 sec latency 68.662 ms 2024-02-19T22:12:40.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:38.571778+0000 mgr.smithi099.zfglya (mgr.14180) 687 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 414 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 13 MiB/s wr, 618 op/s 2024-02-19T22:12:40.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:38.571778+0000 mgr.smithi099.zfglya (mgr.14180) 687 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 414 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 13 MiB/s wr, 618 op/s 2024-02-19T22:12:40.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 39738 51.45 MB/sec warmup 45 sec latency 101.434 ms 2024-02-19T22:12:41.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 25103 31.45 MB/sec warmup 49 sec latency 42.124 ms 2024-02-19T22:12:41.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 39865 50.40 MB/sec warmup 46 sec latency 113.959 ms 2024-02-19T22:12:42.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 25486 31.02 MB/sec warmup 50 sec latency 64.064 ms 2024-02-19T22:12:42.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:40.572375+0000 mgr.smithi099.zfglya (mgr.14180) 688 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 412 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 14 MiB/s wr, 562 op/s 2024-02-19T22:12:42.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:40.572375+0000 mgr.smithi099.zfglya (mgr.14180) 688 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 412 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 14 MiB/s wr, 562 op/s 2024-02-19T22:12:42.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 40951 50.37 MB/sec warmup 47 sec latency 96.327 ms 2024-02-19T22:12:43.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 25917 30.65 MB/sec warmup 51 sec latency 82.545 ms 2024-02-19T22:12:43.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 42350 51.19 MB/sec warmup 48 sec latency 123.991 ms 2024-02-19T22:12:44.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 26422 30.77 MB/sec warmup 52 sec latency 86.103 ms 2024-02-19T22:12:44.294 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:42.572892+0000 mgr.smithi099.zfglya (mgr.14180) 689 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 410 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 12 MiB/s wr, 508 op/s 2024-02-19T22:12:44.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:42.572892+0000 mgr.smithi099.zfglya (mgr.14180) 689 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 410 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 12 MiB/s wr, 508 op/s 2024-02-19T22:12:44.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 43336 51.18 MB/sec warmup 49 sec latency 119.803 ms 2024-02-19T22:12:45.067 INFO:tasks.workunit.client.1.smithi138.stdout: 10 26852 30.29 MB/sec warmup 53 sec latency 93.235 ms 2024-02-19T22:12:45.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 43887 50.77 MB/sec warmup 50 sec latency 79.056 ms 2024-02-19T22:12:46.068 INFO:tasks.workunit.client.1.smithi138.stdout: 10 27419 30.21 MB/sec warmup 54 sec latency 57.453 ms 2024-02-19T22:12:46.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:44.573401+0000 mgr.smithi099.zfglya (mgr.14180) 690 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 423 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 25 KiB/s rd, 12 MiB/s wr, 545 op/s 2024-02-19T22:12:46.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:44.573401+0000 mgr.smithi099.zfglya (mgr.14180) 690 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 423 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 25 KiB/s rd, 12 MiB/s wr, 545 op/s 2024-02-19T22:12:46.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 45251 51.01 MB/sec warmup 51 sec latency 131.344 ms 2024-02-19T22:12:47.068 INFO:tasks.workunit.client.1.smithi138.stdout: 10 28139 30.72 MB/sec warmup 55 sec latency 65.723 ms 2024-02-19T22:12:47.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 46830 51.88 MB/sec warmup 52 sec latency 133.932 ms 2024-02-19T22:12:48.068 INFO:tasks.workunit.client.1.smithi138.stdout: 10 28617 30.89 MB/sec warmup 56 sec latency 50.189 ms 2024-02-19T22:12:48.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:46.573954+0000 mgr.smithi099.zfglya (mgr.14180) 691 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 414 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 16 KiB/s rd, 13 MiB/s wr, 537 op/s 2024-02-19T22:12:48.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:46.573954+0000 mgr.smithi099.zfglya (mgr.14180) 691 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 414 MiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 16 KiB/s rd, 13 MiB/s wr, 537 op/s 2024-02-19T22:12:48.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 46957 50.96 MB/sec warmup 53 sec latency 95.558 ms 2024-02-19T22:12:49.068 INFO:tasks.workunit.client.1.smithi138.stdout: 10 29016 30.56 MB/sec warmup 57 sec latency 33.887 ms 2024-02-19T22:12:49.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 48040 50.92 MB/sec warmup 54 sec latency 110.484 ms 2024-02-19T22:12:50.068 INFO:tasks.workunit.client.1.smithi138.stdout: 10 29482 30.26 MB/sec warmup 58 sec latency 72.841 ms 2024-02-19T22:12:50.453 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:48.574542+0000 mgr.smithi099.zfglya (mgr.14180) 692 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 412 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 12 MiB/s wr, 657 op/s 2024-02-19T22:12:50.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:48.574542+0000 mgr.smithi099.zfglya (mgr.14180) 692 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 412 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 12 MiB/s wr, 657 op/s 2024-02-19T22:12:50.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 49443 51.63 MB/sec warmup 55 sec latency 110.962 ms 2024-02-19T22:12:51.068 INFO:tasks.workunit.client.1.smithi138.stdout: 10 29992 30.36 MB/sec warmup 59 sec latency 85.349 ms 2024-02-19T22:12:51.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 50429 51.61 MB/sec warmup 56 sec latency 95.579 ms 2024-02-19T22:12:52.069 INFO:tasks.workunit.client.1.smithi138.stdout: 10 30393 29.95 MB/sec warmup 60 sec latency 113.335 ms 2024-02-19T22:12:52.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:50.575066+0000 mgr.smithi099.zfglya (mgr.14180) 693 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 418 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 13 MiB/s wr, 560 op/s 2024-02-19T22:12:52.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:50.575066+0000 mgr.smithi099.zfglya (mgr.14180) 693 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 418 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 13 MiB/s wr, 560 op/s 2024-02-19T22:12:52.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 51268 51.55 MB/sec warmup 57 sec latency 91.911 ms 2024-02-19T22:12:53.069 INFO:tasks.workunit.client.1.smithi138.stdout: 10 30928 29.86 MB/sec warmup 61 sec latency 78.385 ms 2024-02-19T22:12:53.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 52609 51.93 MB/sec warmup 58 sec latency 120.276 ms 2024-02-19T22:12:54.069 INFO:tasks.workunit.client.1.smithi138.stdout: 10 31646 30.30 MB/sec warmup 62 sec latency 59.215 ms 2024-02-19T22:12:54.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:52.575583+0000 mgr.smithi099.zfglya (mgr.14180) 694 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 414 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 530 op/s 2024-02-19T22:12:54.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:52.575583+0000 mgr.smithi099.zfglya (mgr.14180) 694 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 414 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 530 op/s 2024-02-19T22:12:54.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 53921 52.21 MB/sec warmup 59 sec latency 112.935 ms 2024-02-19T22:12:55.069 INFO:tasks.workunit.client.1.smithi138.stdout: 10 32158 30.49 MB/sec warmup 63 sec latency 50.853 ms 2024-02-19T22:12:55.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 54091 51.40 MB/sec warmup 60 sec latency 102.109 ms 2024-02-19T22:12:56.069 INFO:tasks.workunit.client.1.smithi138.stdout: 10 32558 30.21 MB/sec warmup 64 sec latency 70.104 ms 2024-02-19T22:12:56.453 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:54.576199+0000 mgr.smithi099.zfglya (mgr.14180) 695 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 415 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 12 MiB/s wr, 575 op/s 2024-02-19T22:12:56.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:54.576199+0000 mgr.smithi099.zfglya (mgr.14180) 695 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 415 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 12 MiB/s wr, 575 op/s 2024-02-19T22:12:56.759 INFO:tasks.workunit.client.0.smithi099.stdout: 10 54893 51.32 MB/sec warmup 61 sec latency 393.077 ms 2024-02-19T22:12:57.069 INFO:tasks.workunit.client.1.smithi138.stdout: 10 33000 29.93 MB/sec warmup 65 sec latency 71.464 ms 2024-02-19T22:12:57.761 INFO:tasks.workunit.client.0.smithi099.stdout: 10 55888 51.21 MB/sec warmup 62 sec latency 334.363 ms 2024-02-19T22:12:58.069 INFO:tasks.workunit.client.1.smithi138.stdout: 10 33501 30.04 MB/sec warmup 66 sec latency 87.923 ms 2024-02-19T22:12:58.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:12:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:56.576772+0000 mgr.smithi099.zfglya (mgr.14180) 696 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 411 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 17 KiB/s rd, 13 MiB/s wr, 570 op/s 2024-02-19T22:12:58.546 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:12:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:56.576772+0000 mgr.smithi099.zfglya (mgr.14180) 696 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 411 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 17 KiB/s rd, 13 MiB/s wr, 570 op/s 2024-02-19T22:12:58.761 INFO:tasks.workunit.client.0.smithi099.stdout: 10 57459 51.92 MB/sec warmup 63 sec latency 130.121 ms 2024-02-19T22:12:59.069 INFO:tasks.workunit.client.1.smithi138.stdout: 10 33915 29.66 MB/sec warmup 67 sec latency 70.836 ms 2024-02-19T22:12:59.761 INFO:tasks.workunit.client.0.smithi099.stdout: 10 57591 51.16 MB/sec warmup 64 sec latency 87.408 ms 2024-02-19T22:13:00.069 INFO:tasks.workunit.client.1.smithi138.stdout: 10 34462 29.58 MB/sec warmup 68 sec latency 80.542 ms 2024-02-19T22:13:00.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:12:58.577334+0000 mgr.smithi099.zfglya (mgr.14180) 697 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 417 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 26 KiB/s rd, 13 MiB/s wr, 625 op/s 2024-02-19T22:13:00.572 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:12:58.577334+0000 mgr.smithi099.zfglya (mgr.14180) 697 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 417 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 26 KiB/s rd, 13 MiB/s wr, 625 op/s 2024-02-19T22:13:00.761 INFO:tasks.workunit.client.0.smithi099.stdout: 10 58672 51.13 MB/sec warmup 65 sec latency 108.687 ms 2024-02-19T22:13:01.069 INFO:tasks.workunit.client.1.smithi138.stdout: 10 35081 29.93 MB/sec warmup 69 sec latency 66.856 ms 2024-02-19T22:13:01.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 60033 51.65 MB/sec warmup 66 sec latency 117.695 ms 2024-02-19T22:13:02.069 INFO:tasks.workunit.client.1.smithi138.stdout: 10 35632 30.15 MB/sec warmup 70 sec latency 45.821 ms 2024-02-19T22:13:02.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:00.577825+0000 mgr.smithi099.zfglya (mgr.14180) 698 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 407 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 13 MiB/s wr, 527 op/s 2024-02-19T22:13:02.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:00.577825+0000 mgr.smithi099.zfglya (mgr.14180) 698 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 407 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 13 MiB/s wr, 527 op/s 2024-02-19T22:13:02.761 INFO:tasks.workunit.client.0.smithi099.stdout: 10 61043 51.69 MB/sec warmup 67 sec latency 269.138 ms 2024-02-19T22:13:03.069 INFO:tasks.workunit.client.1.smithi138.stdout: 10 36047 29.90 MB/sec warmup 71 sec latency 53.666 ms 2024-02-19T22:13:03.761 INFO:tasks.workunit.client.0.smithi099.stdout: 10 61067 50.94 MB/sec warmup 68 sec latency 372.716 ms 2024-02-19T22:13:04.070 INFO:tasks.workunit.client.1.smithi138.stdout: 10 36444 29.64 MB/sec warmup 72 sec latency 73.296 ms 2024-02-19T22:13:04.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:02.578285+0000 mgr.smithi099.zfglya (mgr.14180) 699 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 408 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 12 MiB/s wr, 574 op/s 2024-02-19T22:13:04.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:02.578285+0000 mgr.smithi099.zfglya (mgr.14180) 699 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 408 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 12 MiB/s wr, 574 op/s 2024-02-19T22:13:04.761 INFO:tasks.workunit.client.0.smithi099.stdout: 10 61070 50.20 MB/sec warmup 69 sec latency 517.199 ms 2024-02-19T22:13:05.071 INFO:tasks.workunit.client.1.smithi138.stdout: 10 36865 29.49 MB/sec warmup 73 sec latency 72.044 ms 2024-02-19T22:13:05.761 INFO:tasks.workunit.client.0.smithi099.stdout: 10 61129 49.50 MB/sec warmup 70 sec latency 591.715 ms 2024-02-19T22:13:06.071 INFO:tasks.workunit.client.1.smithi138.stdout: 10 37270 29.41 MB/sec warmup 74 sec latency 93.969 ms 2024-02-19T22:13:06.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:04.579674+0000 mgr.smithi099.zfglya (mgr.14180) 700 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 415 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 12 MiB/s wr, 553 op/s 2024-02-19T22:13:06.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:04.579674+0000 mgr.smithi099.zfglya (mgr.14180) 700 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 415 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 23 KiB/s rd, 12 MiB/s wr, 553 op/s 2024-02-19T22:13:06.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 61135 48.81 MB/sec warmup 71 sec latency 376.316 ms 2024-02-19T22:13:07.071 INFO:tasks.workunit.client.1.smithi138.stdout: 10 37779 29.19 MB/sec warmup 75 sec latency 77.815 ms 2024-02-19T22:13:07.761 INFO:tasks.workunit.client.0.smithi099.stdout: 10 61817 48.77 MB/sec warmup 72 sec latency 366.836 ms 2024-02-19T22:13:08.071 INFO:tasks.workunit.client.1.smithi138.stdout: 10 38322 29.30 MB/sec warmup 76 sec latency 71.029 ms 2024-02-19T22:13:08.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:06.580110+0000 mgr.smithi099.zfglya (mgr.14180) 701 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 422 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 13 MiB/s wr, 513 op/s 2024-02-19T22:13:08.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:06.580110+0000 mgr.smithi099.zfglya (mgr.14180) 701 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 422 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 13 MiB/s wr, 513 op/s 2024-02-19T22:13:08.761 INFO:tasks.workunit.client.0.smithi099.stdout: 10 63248 49.12 MB/sec warmup 73 sec latency 104.654 ms 2024-02-19T22:13:09.071 INFO:tasks.workunit.client.1.smithi138.stdout: 10 38970 29.59 MB/sec warmup 77 sec latency 49.193 ms 2024-02-19T22:13:09.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 64554 49.37 MB/sec warmup 74 sec latency 104.044 ms 2024-02-19T22:13:10.071 INFO:tasks.workunit.client.1.smithi138.stdout: 10 39458 29.64 MB/sec warmup 78 sec latency 76.084 ms 2024-02-19T22:13:10.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:08.580542+0000 mgr.smithi099.zfglya (mgr.14180) 702 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 420 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 559 op/s 2024-02-19T22:13:10.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:08.580542+0000 mgr.smithi099.zfglya (mgr.14180) 702 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 420 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 559 op/s 2024-02-19T22:13:10.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 64680 48.76 MB/sec warmup 75 sec latency 93.692 ms 2024-02-19T22:13:11.072 INFO:tasks.workunit.client.1.smithi138.stdout: 10 39856 29.39 MB/sec warmup 79 sec latency 69.318 ms 2024-02-19T22:13:11.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 65763 48.76 MB/sec warmup 76 sec latency 105.708 ms 2024-02-19T22:13:12.072 INFO:tasks.workunit.client.1.smithi138.stdout: 10 40358 29.29 MB/sec warmup 80 sec latency 25.675 ms 2024-02-19T22:13:12.452 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:10.581134+0000 mgr.smithi099.zfglya (mgr.14180) 703 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 421 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 13 MiB/s wr, 544 op/s 2024-02-19T22:13:12.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:10.581134+0000 mgr.smithi099.zfglya (mgr.14180) 703 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 421 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 13 MiB/s wr, 544 op/s 2024-02-19T22:13:12.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 67173 49.29 MB/sec warmup 77 sec latency 105.723 ms 2024-02-19T22:13:13.072 INFO:tasks.workunit.client.1.smithi138.stdout: 10 40794 29.23 MB/sec warmup 81 sec latency 86.054 ms 2024-02-19T22:13:13.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 68162 49.31 MB/sec warmup 78 sec latency 100.258 ms 2024-02-19T22:13:14.072 INFO:tasks.workunit.client.1.smithi138.stdout: 10 41247 29.00 MB/sec warmup 82 sec latency 94.158 ms 2024-02-19T22:13:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:12.581675+0000 mgr.smithi099.zfglya (mgr.14180) 704 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 430 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 13 MiB/s wr, 558 op/s 2024-02-19T22:13:14.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:12.581675+0000 mgr.smithi099.zfglya (mgr.14180) 704 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 430 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 13 MiB/s wr, 558 op/s 2024-02-19T22:13:14.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 68710 49.08 MB/sec warmup 79 sec latency 93.778 ms 2024-02-19T22:13:15.072 INFO:tasks.workunit.client.1.smithi138.stdout: 10 41719 28.98 MB/sec warmup 83 sec latency 74.782 ms 2024-02-19T22:13:15.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:13:14.718605+0000 mon.smithi099 (mon.0) 801 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:13:15.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:13:15.074543+0000 mon.smithi099 (mon.0) 802 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:13:15.504 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:13:14.718605+0000 mon.smithi099 (mon.0) 801 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:13:15.505 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:13:15.074543+0000 mon.smithi099 (mon.0) 802 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:13:15.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 70339 49.60 MB/sec warmup 80 sec latency 107.512 ms 2024-02-19T22:13:16.072 INFO:tasks.workunit.client.1.smithi138.stdout: 10 42404 29.33 MB/sec warmup 84 sec latency 86.640 ms 2024-02-19T22:13:16.453 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:14.582136+0000 mgr.smithi099.zfglya (mgr.14180) 705 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 430 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 542 op/s 2024-02-19T22:13:16.454 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:13:15.539658+0000 mon.smithi099 (mon.0) 803 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:13:16.454 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:13:15.540659+0000 mon.smithi099 (mon.0) 804 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:13:16.454 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:13:15.545652+0000 mon.smithi099 (mon.0) 805 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:13:16.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:14.582136+0000 mgr.smithi099.zfglya (mgr.14180) 705 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 430 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 542 op/s 2024-02-19T22:13:16.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:13:15.539658+0000 mon.smithi099 (mon.0) 803 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:13:16.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:13:15.540659+0000 mon.smithi099 (mon.0) 804 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:13:16.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:13:15.545652+0000 mon.smithi099 (mon.0) 805 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:13:16.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 71648 49.83 MB/sec warmup 81 sec latency 111.847 ms 2024-02-19T22:13:17.072 INFO:tasks.workunit.client.1.smithi138.stdout: 10 42849 29.38 MB/sec warmup 85 sec latency 33.707 ms 2024-02-19T22:13:17.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 71846 49.28 MB/sec warmup 82 sec latency 101.473 ms 2024-02-19T22:13:18.072 INFO:tasks.workunit.client.1.smithi138.stdout: 10 43189 29.15 MB/sec warmup 86 sec latency 63.182 ms 2024-02-19T22:13:18.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:16.582687+0000 mgr.smithi099.zfglya (mgr.14180) 706 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 422 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 13 MiB/s wr, 595 op/s 2024-02-19T22:13:18.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:16.582687+0000 mgr.smithi099.zfglya (mgr.14180) 706 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 422 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 13 MiB/s wr, 595 op/s 2024-02-19T22:13:18.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 73343 49.45 MB/sec warmup 83 sec latency 111.359 ms 2024-02-19T22:13:19.072 INFO:tasks.workunit.client.1.smithi138.stdout: 10 43579 28.94 MB/sec warmup 87 sec latency 77.831 ms 2024-02-19T22:13:19.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 74322 49.75 MB/sec warmup 84 sec latency 130.341 ms 2024-02-19T22:13:20.073 INFO:tasks.workunit.client.1.smithi138.stdout: 10 44013 28.81 MB/sec warmup 88 sec latency 116.913 ms 2024-02-19T22:13:20.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:18.583203+0000 mgr.smithi099.zfglya (mgr.14180) 707 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 416 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 612 op/s 2024-02-19T22:13:20.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:18.583203+0000 mgr.smithi099.zfglya (mgr.14180) 707 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 416 MiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 612 op/s 2024-02-19T22:13:20.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 75321 49.77 MB/sec warmup 85 sec latency 87.471 ms 2024-02-19T22:13:21.073 INFO:tasks.workunit.client.1.smithi138.stdout: 10 44421 28.76 MB/sec warmup 89 sec latency 98.707 ms 2024-02-19T22:13:21.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 76121 49.74 MB/sec warmup 86 sec latency 106.330 ms 2024-02-19T22:13:22.075 INFO:tasks.workunit.client.1.smithi138.stdout: 10 44940 28.59 MB/sec warmup 90 sec latency 77.509 ms 2024-02-19T22:13:22.452 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:20.583720+0000 mgr.smithi099.zfglya (mgr.14180) 708 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 431 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 13 MiB/s wr, 559 op/s 2024-02-19T22:13:22.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:20.583720+0000 mgr.smithi099.zfglya (mgr.14180) 708 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 431 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 13 MiB/s wr, 559 op/s 2024-02-19T22:13:22.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 77500 50.01 MB/sec warmup 87 sec latency 149.860 ms 2024-02-19T22:13:23.075 INFO:tasks.workunit.client.1.smithi138.stdout: 10 45453 28.76 MB/sec warmup 91 sec latency 68.293 ms 2024-02-19T22:13:23.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 78773 50.22 MB/sec warmup 88 sec latency 99.048 ms 2024-02-19T22:13:24.076 INFO:tasks.workunit.client.1.smithi138.stdout: 10 46050 28.92 MB/sec warmup 92 sec latency 44.017 ms 2024-02-19T22:13:24.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:22.586100+0000 mgr.smithi099.zfglya (mgr.14180) 709 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 423 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 501 op/s 2024-02-19T22:13:24.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:22.586100+0000 mgr.smithi099.zfglya (mgr.14180) 709 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 423 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 501 op/s 2024-02-19T22:13:24.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 78899 49.69 MB/sec warmup 89 sec latency 100.660 ms 2024-02-19T22:13:25.076 INFO:tasks.workunit.client.1.smithi138.stdout: 10 46405 28.91 MB/sec warmup 93 sec latency 134.729 ms 2024-02-19T22:13:25.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 79981 49.68 MB/sec warmup 90 sec latency 113.092 ms 2024-02-19T22:13:26.076 INFO:tasks.workunit.client.1.smithi138.stdout: 10 46740 28.71 MB/sec warmup 94 sec latency 28.190 ms 2024-02-19T22:13:26.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:24.586973+0000 mgr.smithi099.zfglya (mgr.14180) 710 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 431 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 11 MiB/s wr, 545 op/s 2024-02-19T22:13:26.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:24.586973+0000 mgr.smithi099.zfglya (mgr.14180) 710 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 431 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 11 MiB/s wr, 545 op/s 2024-02-19T22:13:26.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 81388 50.12 MB/sec warmup 91 sec latency 122.844 ms 2024-02-19T22:13:27.076 INFO:tasks.workunit.client.1.smithi138.stdout: 10 47105 28.51 MB/sec warmup 95 sec latency 74.558 ms 2024-02-19T22:13:27.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 82371 50.13 MB/sec warmup 92 sec latency 213.676 ms 2024-02-19T22:13:28.078 INFO:tasks.workunit.client.1.smithi138.stdout: 10 47517 28.40 MB/sec warmup 96 sec latency 104.078 ms 2024-02-19T22:13:28.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:26.587420+0000 mgr.smithi099.zfglya (mgr.14180) 711 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 430 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 520 op/s 2024-02-19T22:13:28.549 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:26.587420+0000 mgr.smithi099.zfglya (mgr.14180) 711 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 430 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 520 op/s 2024-02-19T22:13:28.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 82446 49.61 MB/sec warmup 93 sec latency 383.860 ms 2024-02-19T22:13:29.082 INFO:tasks.workunit.client.1.smithi138.stdout: 10 47915 28.36 MB/sec warmup 97 sec latency 116.336 ms 2024-02-19T22:13:29.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 83982 49.76 MB/sec warmup 94 sec latency 99.942 ms 2024-02-19T22:13:30.082 INFO:tasks.workunit.client.1.smithi138.stdout: 10 48421 28.21 MB/sec warmup 98 sec latency 101.448 ms 2024-02-19T22:13:30.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:28.587971+0000 mgr.smithi099.zfglya (mgr.14180) 712 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 435 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 12 MiB/s wr, 513 op/s 2024-02-19T22:13:30.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:28.587971+0000 mgr.smithi099.zfglya (mgr.14180) 712 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 435 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 12 MiB/s wr, 513 op/s 2024-02-19T22:13:30.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 84966 50.03 MB/sec warmup 95 sec latency 105.340 ms 2024-02-19T22:13:31.082 INFO:tasks.workunit.client.1.smithi138.stdout: 10 49000 28.31 MB/sec warmup 99 sec latency 66.762 ms 2024-02-19T22:13:31.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 85979 50.05 MB/sec warmup 96 sec latency 85.344 ms 2024-02-19T22:13:32.082 INFO:tasks.workunit.client.1.smithi138.stdout: 10 49652 28.53 MB/sec warmup 100 sec latency 56.495 ms 2024-02-19T22:13:32.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:30.588464+0000 mgr.smithi099.zfglya (mgr.14180) 713 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 416 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 17 KiB/s rd, 11 MiB/s wr, 498 op/s 2024-02-19T22:13:32.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:30.588464+0000 mgr.smithi099.zfglya (mgr.14180) 713 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 416 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 17 KiB/s rd, 11 MiB/s wr, 498 op/s 2024-02-19T22:13:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: 10 86815 50.02 MB/sec warmup 97 sec latency 123.012 ms 2024-02-19T22:13:33.082 INFO:tasks.workunit.client.1.smithi138.stdout: 10 50145 28.59 MB/sec warmup 101 sec latency 71.264 ms 2024-02-19T22:13:33.763 INFO:tasks.workunit.client.0.smithi099.stdout: 10 88175 50.26 MB/sec warmup 98 sec latency 103.385 ms 2024-02-19T22:13:34.082 INFO:tasks.workunit.client.1.smithi138.stdout: 10 50574 28.41 MB/sec warmup 102 sec latency 90.910 ms 2024-02-19T22:13:34.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:32.588943+0000 mgr.smithi099.zfglya (mgr.14180) 714 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 417 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 17 KiB/s rd, 10 MiB/s wr, 507 op/s 2024-02-19T22:13:34.545 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:32.588943+0000 mgr.smithi099.zfglya (mgr.14180) 714 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 417 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 17 KiB/s rd, 10 MiB/s wr, 507 op/s 2024-02-19T22:13:34.763 INFO:tasks.workunit.client.0.smithi099.stdout: 10 89461 50.44 MB/sec warmup 99 sec latency 99.566 ms 2024-02-19T22:13:35.082 INFO:tasks.workunit.client.1.smithi138.stdout: 10 50865 28.25 MB/sec warmup 103 sec latency 383.225 ms 2024-02-19T22:13:35.763 INFO:tasks.workunit.client.0.smithi099.stdout: 10 89684 49.99 MB/sec warmup 100 sec latency 103.341 ms 2024-02-19T22:13:36.082 INFO:tasks.workunit.client.1.smithi138.stdout: 10 51340 28.27 MB/sec warmup 104 sec latency 74.313 ms 2024-02-19T22:13:36.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:34.591639+0000 mgr.smithi099.zfglya (mgr.14180) 715 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 424 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 11 MiB/s wr, 608 op/s 2024-02-19T22:13:36.545 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:34.591639+0000 mgr.smithi099.zfglya (mgr.14180) 715 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 424 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 11 MiB/s wr, 608 op/s 2024-02-19T22:13:36.763 INFO:tasks.workunit.client.0.smithi099.stdout: 10 91124 50.11 MB/sec warmup 101 sec latency 118.889 ms 2024-02-19T22:13:37.083 INFO:tasks.workunit.client.1.smithi138.stdout: 10 51762 28.09 MB/sec warmup 105 sec latency 87.478 ms 2024-02-19T22:13:37.763 INFO:tasks.workunit.client.0.smithi099.stdout: 10 92947 50.82 MB/sec warmup 102 sec latency 115.837 ms 2024-02-19T22:13:38.083 INFO:tasks.workunit.client.1.smithi138.stdout: 10 52296 28.06 MB/sec warmup 106 sec latency 58.607 ms 2024-02-19T22:13:38.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:36.592185+0000 mgr.smithi099.zfglya (mgr.14180) 716 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 436 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 589 op/s 2024-02-19T22:13:38.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:36.592185+0000 mgr.smithi099.zfglya (mgr.14180) 716 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 436 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 589 op/s 2024-02-19T22:13:38.763 INFO:tasks.workunit.client.0.smithi099.stdout: 10 93010 50.34 MB/sec warmup 103 sec latency 318.919 ms 2024-02-19T22:13:39.083 INFO:tasks.workunit.client.1.smithi138.stdout: 10 52922 28.30 MB/sec warmup 107 sec latency 66.730 ms 2024-02-19T22:13:39.764 INFO:tasks.workunit.client.0.smithi099.stdout: 10 93070 49.87 MB/sec warmup 104 sec latency 384.609 ms 2024-02-19T22:13:40.083 INFO:tasks.workunit.client.1.smithi138.stdout: 10 53378 28.36 MB/sec warmup 108 sec latency 69.907 ms 2024-02-19T22:13:40.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:38.592622+0000 mgr.smithi099.zfglya (mgr.14180) 717 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 433 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 11 MiB/s wr, 646 op/s 2024-02-19T22:13:40.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:38.592622+0000 mgr.smithi099.zfglya (mgr.14180) 717 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 433 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 11 MiB/s wr, 646 op/s 2024-02-19T22:13:40.763 INFO:tasks.workunit.client.0.smithi099.stdout: 10 93075 49.40 MB/sec warmup 105 sec latency 625.491 ms 2024-02-19T22:13:41.083 INFO:tasks.workunit.client.1.smithi138.stdout: 10 53758 28.26 MB/sec warmup 109 sec latency 84.108 ms 2024-02-19T22:13:41.764 INFO:tasks.workunit.client.0.smithi099.stdout: 10 93079 48.93 MB/sec warmup 106 sec latency 524.023 ms 2024-02-19T22:13:42.083 INFO:tasks.workunit.client.1.smithi138.stdout: 10 54092 28.07 MB/sec warmup 110 sec latency 126.426 ms 2024-02-19T22:13:42.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:40.593077+0000 mgr.smithi099.zfglya (mgr.14180) 718 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 430 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 672 op/s 2024-02-19T22:13:42.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:40.593077+0000 mgr.smithi099.zfglya (mgr.14180) 718 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 430 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 672 op/s 2024-02-19T22:13:42.764 INFO:tasks.workunit.client.0.smithi099.stdout: 10 93193 48.50 MB/sec warmup 107 sec latency 407.607 ms 2024-02-19T22:13:43.083 INFO:tasks.workunit.client.1.smithi138.stdout: 10 54595 28.03 MB/sec warmup 111 sec latency 64.804 ms 2024-02-19T22:13:43.764 INFO:tasks.workunit.client.0.smithi099.stdout: 10 94632 48.62 MB/sec warmup 108 sec latency 135.758 ms 2024-02-19T22:13:44.083 INFO:tasks.workunit.client.1.smithi138.stdout: 10 55050 27.98 MB/sec warmup 112 sec latency 121.209 ms 2024-02-19T22:13:44.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:42.593526+0000 mgr.smithi099.zfglya (mgr.14180) 719 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 427 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 13 MiB/s wr, 715 op/s 2024-02-19T22:13:44.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:42.593526+0000 mgr.smithi099.zfglya (mgr.14180) 719 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 427 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 13 MiB/s wr, 715 op/s 2024-02-19T22:13:44.764 INFO:tasks.workunit.client.0.smithi099.stdout: 10 95606 48.86 MB/sec warmup 109 sec latency 110.459 ms 2024-02-19T22:13:45.083 INFO:tasks.workunit.client.1.smithi138.stdout: 10 55540 27.86 MB/sec warmup 113 sec latency 96.578 ms 2024-02-19T22:13:45.764 INFO:tasks.workunit.client.0.smithi099.stdout: 10 96589 48.88 MB/sec warmup 110 sec latency 102.332 ms 2024-02-19T22:13:46.086 INFO:tasks.workunit.client.1.smithi138.stdout: 10 56071 27.91 MB/sec warmup 114 sec latency 61.648 ms 2024-02-19T22:13:46.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:44.595624+0000 mgr.smithi099.zfglya (mgr.14180) 720 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 432 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 12 MiB/s wr, 669 op/s 2024-02-19T22:13:46.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:44.595624+0000 mgr.smithi099.zfglya (mgr.14180) 720 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 432 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 12 MiB/s wr, 669 op/s 2024-02-19T22:13:46.764 INFO:tasks.workunit.client.0.smithi099.stdout: 10 97379 48.87 MB/sec warmup 111 sec latency 111.475 ms 2024-02-19T22:13:47.086 INFO:tasks.workunit.client.1.smithi138.stdout: 10 56710 28.12 MB/sec warmup 115 sec latency 62.377 ms 2024-02-19T22:13:47.764 INFO:tasks.workunit.client.0.smithi099.stdout: 10 98739 49.09 MB/sec warmup 112 sec latency 115.553 ms 2024-02-19T22:13:48.086 INFO:tasks.workunit.client.1.smithi138.stdout: 10 57198 28.17 MB/sec warmup 116 sec latency 46.378 ms 2024-02-19T22:13:48.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:46.596185+0000 mgr.smithi099.zfglya (mgr.14180) 721 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 427 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 16 KiB/s rd, 12 MiB/s wr, 628 op/s 2024-02-19T22:13:48.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:46.596185+0000 mgr.smithi099.zfglya (mgr.14180) 721 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 427 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 16 KiB/s rd, 12 MiB/s wr, 628 op/s 2024-02-19T22:13:48.764 INFO:tasks.workunit.client.0.smithi099.stdout: 10 100047 49.26 MB/sec warmup 113 sec latency 110.889 ms 2024-02-19T22:13:49.086 INFO:tasks.workunit.client.1.smithi138.stdout: 10 57510 28.01 MB/sec warmup 117 sec latency 55.110 ms 2024-02-19T22:13:49.764 INFO:tasks.workunit.client.0.smithi099.stdout: 10 100209 48.86 MB/sec warmup 114 sec latency 109.116 ms 2024-02-19T22:13:50.087 INFO:tasks.workunit.client.1.smithi138.stdout: 10 57802 27.84 MB/sec warmup 118 sec latency 115.892 ms 2024-02-19T22:13:50.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:48.596640+0000 mgr.smithi099.zfglya (mgr.14180) 722 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 424 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 11 MiB/s wr, 608 op/s 2024-02-19T22:13:50.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:48.596640+0000 mgr.smithi099.zfglya (mgr.14180) 722 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 424 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 11 MiB/s wr, 608 op/s 2024-02-19T22:13:50.764 INFO:tasks.workunit.client.0.smithi099.stdout: 10 101481 48.92 MB/sec warmup 115 sec latency 109.968 ms 2024-02-19T22:13:51.087 INFO:tasks.workunit.client.1.smithi138.stdout: 10 58233 27.76 MB/sec warmup 119 sec latency 112.045 ms 2024-02-19T22:13:51.764 INFO:tasks.workunit.client.0.smithi099.stdout: 10 102674 49.21 MB/sec warmup 116 sec latency 120.700 ms 2024-02-19T22:13:52.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:50.597169+0000 mgr.smithi099.zfglya (mgr.14180) 723 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 434 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 13 MiB/s wr, 596 op/s 2024-02-19T22:13:52.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:50.597169+0000 mgr.smithi099.zfglya (mgr.14180) 723 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 434 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 13 MiB/s wr, 596 op/s 2024-02-19T22:13:52.764 INFO:tasks.workunit.client.0.smithi099.stdout: 10 103652 49.22 MB/sec warmup 117 sec latency 91.972 ms 2024-02-19T22:13:53.090 INFO:tasks.workunit.client.1.smithi138.stdout: 10 59291 21.15 MB/sec execute 1 sec latency 84.678 ms 2024-02-19T22:13:53.764 INFO:tasks.workunit.client.0.smithi099.stdout: 10 104398 49.21 MB/sec warmup 118 sec latency 97.173 ms 2024-02-19T22:13:54.088 INFO:tasks.workunit.client.1.smithi138.stdout: 10 59935 37.09 MB/sec execute 2 sec latency 74.189 ms 2024-02-19T22:13:54.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:52.597653+0000 mgr.smithi099.zfglya (mgr.14180) 724 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 423 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 572 op/s 2024-02-19T22:13:54.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:52.597653+0000 mgr.smithi099.zfglya (mgr.14180) 724 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 423 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 572 op/s 2024-02-19T22:13:54.765 INFO:tasks.workunit.client.0.smithi099.stdout: 10 105829 49.42 MB/sec warmup 119 sec latency 135.110 ms 2024-02-19T22:13:55.088 INFO:tasks.workunit.client.1.smithi138.stdout: 10 60481 38.26 MB/sec execute 3 sec latency 60.411 ms 2024-02-19T22:13:56.088 INFO:tasks.workunit.client.1.smithi138.stdout: 10 60952 34.11 MB/sec execute 4 sec latency 48.712 ms 2024-02-19T22:13:56.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:54.598053+0000 mgr.smithi099.zfglya (mgr.14180) 725 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 421 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 10 MiB/s wr, 499 op/s 2024-02-19T22:13:56.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:54.598053+0000 mgr.smithi099.zfglya (mgr.14180) 725 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 421 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 10 MiB/s wr, 499 op/s 2024-02-19T22:13:56.765 INFO:tasks.workunit.client.0.smithi099.stdout: 10 107298 3.94 MB/sec execute 1 sec latency 121.408 ms 2024-02-19T22:13:57.088 INFO:tasks.workunit.client.1.smithi138.stdout: 10 61244 28.24 MB/sec execute 5 sec latency 99.263 ms 2024-02-19T22:13:57.765 INFO:tasks.workunit.client.0.smithi099.stdout: 10 108344 26.03 MB/sec execute 2 sec latency 120.190 ms 2024-02-19T22:13:58.088 INFO:tasks.workunit.client.1.smithi138.stdout: 10 61677 27.28 MB/sec execute 6 sec latency 29.993 ms 2024-02-19T22:13:58.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:13:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:56.598615+0000 mgr.smithi099.zfglya (mgr.14180) 726 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 424 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 13 MiB/s wr, 576 op/s 2024-02-19T22:13:58.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:13:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:56.598615+0000 mgr.smithi099.zfglya (mgr.14180) 726 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 424 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 13 MiB/s wr, 576 op/s 2024-02-19T22:13:58.765 INFO:tasks.workunit.client.0.smithi099.stdout: 10 109435 41.15 MB/sec execute 3 sec latency 315.039 ms 2024-02-19T22:13:59.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 61992 26.02 MB/sec execute 7 sec latency 145.472 ms 2024-02-19T22:13:59.765 INFO:tasks.workunit.client.0.smithi099.stdout: 10 110677 47.76 MB/sec execute 4 sec latency 365.740 ms 2024-02-19T22:14:00.089 INFO:tasks.workunit.client.1.smithi138.stdout: 10 62400 24.37 MB/sec execute 8 sec latency 134.235 ms 2024-02-19T22:14:00.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:13:58.599965+0000 mgr.smithi099.zfglya (mgr.14180) 727 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 429 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 24 KiB/s rd, 12 MiB/s wr, 555 op/s 2024-02-19T22:14:00.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:13:58.599965+0000 mgr.smithi099.zfglya (mgr.14180) 727 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 429 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 24 KiB/s rd, 12 MiB/s wr, 555 op/s 2024-02-19T22:14:00.765 INFO:tasks.workunit.client.0.smithi099.stdout: 10 110807 38.82 MB/sec execute 5 sec latency 84.763 ms 2024-02-19T22:14:01.089 INFO:tasks.workunit.client.1.smithi138.stdout: 10 62882 24.06 MB/sec execute 9 sec latency 30.092 ms 2024-02-19T22:14:01.765 INFO:tasks.workunit.client.0.smithi099.stdout: 10 111891 40.53 MB/sec execute 6 sec latency 111.227 ms 2024-02-19T22:14:02.089 INFO:tasks.workunit.client.1.smithi138.stdout: 10 63551 27.18 MB/sec execute 10 sec latency 46.017 ms 2024-02-19T22:14:02.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:00.600429+0000 mgr.smithi099.zfglya (mgr.14180) 728 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 419 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 12 MiB/s wr, 575 op/s 2024-02-19T22:14:02.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:00.600429+0000 mgr.smithi099.zfglya (mgr.14180) 728 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 419 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 12 MiB/s wr, 575 op/s 2024-02-19T22:14:02.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 113300 47.59 MB/sec execute 7 sec latency 121.502 ms 2024-02-19T22:14:03.089 INFO:tasks.workunit.client.1.smithi138.stdout: 10 64045 27.86 MB/sec execute 11 sec latency 51.029 ms 2024-02-19T22:14:03.765 INFO:tasks.workunit.client.0.smithi099.stdout: 10 114285 47.97 MB/sec execute 8 sec latency 86.194 ms 2024-02-19T22:14:04.089 INFO:tasks.workunit.client.1.smithi138.stdout: 10 64465 27.08 MB/sec execute 12 sec latency 82.893 ms 2024-02-19T22:14:04.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:02.600957+0000 mgr.smithi099.zfglya (mgr.14180) 729 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 413 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 11 MiB/s wr, 537 op/s 2024-02-19T22:14:04.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:02.600957+0000 mgr.smithi099.zfglya (mgr.14180) 729 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 413 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 18 KiB/s rd, 11 MiB/s wr, 537 op/s 2024-02-19T22:14:04.765 INFO:tasks.workunit.client.0.smithi099.stdout: 10 115031 47.90 MB/sec execute 9 sec latency 89.239 ms 2024-02-19T22:14:05.089 INFO:tasks.workunit.client.1.smithi138.stdout: 10 64894 25.98 MB/sec execute 13 sec latency 94.504 ms 2024-02-19T22:14:05.765 INFO:tasks.workunit.client.0.smithi099.stdout: 10 116462 50.55 MB/sec execute 10 sec latency 120.514 ms 2024-02-19T22:14:06.089 INFO:tasks.workunit.client.1.smithi138.stdout: 10 65325 25.49 MB/sec execute 14 sec latency 72.171 ms 2024-02-19T22:14:06.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:04.602065+0000 mgr.smithi099.zfglya (mgr.14180) 730 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 419 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 10 MiB/s wr, 537 op/s 2024-02-19T22:14:06.545 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:04.602065+0000 mgr.smithi099.zfglya (mgr.14180) 730 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 419 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 10 MiB/s wr, 537 op/s 2024-02-19T22:14:06.765 INFO:tasks.workunit.client.0.smithi099.stdout: 10 117778 52.15 MB/sec execute 11 sec latency 106.298 ms 2024-02-19T22:14:07.089 INFO:tasks.workunit.client.1.smithi138.stdout: 10 65790 25.49 MB/sec execute 15 sec latency 93.631 ms 2024-02-19T22:14:07.765 INFO:tasks.workunit.client.0.smithi099.stdout: 10 117976 48.20 MB/sec execute 12 sec latency 97.239 ms 2024-02-19T22:14:08.089 INFO:tasks.workunit.client.1.smithi138.stdout: 10 66330 25.05 MB/sec execute 16 sec latency 94.368 ms 2024-02-19T22:14:08.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:06.602560+0000 mgr.smithi099.zfglya (mgr.14180) 731 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 430 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 13 MiB/s wr, 581 op/s 2024-02-19T22:14:08.546 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:06.602560+0000 mgr.smithi099.zfglya (mgr.14180) 731 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 430 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 13 MiB/s wr, 581 op/s 2024-02-19T22:14:08.766 INFO:tasks.workunit.client.0.smithi099.stdout: 10 119468 49.34 MB/sec execute 13 sec latency 111.692 ms 2024-02-19T22:14:09.089 INFO:tasks.workunit.client.1.smithi138.stdout: 10 66949 26.49 MB/sec execute 17 sec latency 77.466 ms 2024-02-19T22:14:09.766 INFO:tasks.workunit.client.0.smithi099.stdout: 10 120393 51.10 MB/sec execute 14 sec latency 247.909 ms 2024-02-19T22:14:10.089 INFO:tasks.workunit.client.1.smithi138.stdout: 10 67458 27.02 MB/sec execute 18 sec latency 71.392 ms 2024-02-19T22:14:10.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:08.603113+0000 mgr.smithi099.zfglya (mgr.14180) 732 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 421 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 11 MiB/s wr, 527 op/s 2024-02-19T22:14:10.546 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:08.603113+0000 mgr.smithi099.zfglya (mgr.14180) 732 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 421 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 11 MiB/s wr, 527 op/s 2024-02-19T22:14:10.766 INFO:tasks.workunit.client.0.smithi099.stdout: 10 121372 51.07 MB/sec execute 15 sec latency 338.281 ms 2024-02-19T22:14:11.089 INFO:tasks.workunit.client.1.smithi138.stdout: 10 67877 27.06 MB/sec execute 19 sec latency 54.189 ms 2024-02-19T22:14:11.766 INFO:tasks.workunit.client.0.smithi099.stdout: 10 121624 48.25 MB/sec execute 16 sec latency 91.935 ms 2024-02-19T22:14:12.089 INFO:tasks.workunit.client.1.smithi138.stdout: 10 68251 26.11 MB/sec execute 20 sec latency 83.468 ms 2024-02-19T22:14:12.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:10.603601+0000 mgr.smithi099.zfglya (mgr.14180) 733 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 420 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 536 op/s 2024-02-19T22:14:12.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:10.603601+0000 mgr.smithi099.zfglya (mgr.14180) 733 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 420 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 536 op/s 2024-02-19T22:14:12.766 INFO:tasks.workunit.client.0.smithi099.stdout: 10 123283 50.57 MB/sec execute 17 sec latency 113.492 ms 2024-02-19T22:14:13.089 INFO:tasks.workunit.client.1.smithi138.stdout: 10 68662 25.58 MB/sec execute 21 sec latency 95.424 ms 2024-02-19T22:14:13.766 INFO:tasks.workunit.client.0.smithi099.stdout: 10 124862 53.10 MB/sec execute 18 sec latency 120.154 ms 2024-02-19T22:14:14.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 69090 25.54 MB/sec execute 22 sec latency 137.248 ms 2024-02-19T22:14:14.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:12.604362+0000 mgr.smithi099.zfglya (mgr.14180) 734 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 428 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 546 op/s 2024-02-19T22:14:14.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:12.604362+0000 mgr.smithi099.zfglya (mgr.14180) 734 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 428 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 546 op/s 2024-02-19T22:14:14.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 124990 50.47 MB/sec execute 19 sec latency 100.629 ms 2024-02-19T22:14:15.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 69553 25.19 MB/sec execute 23 sec latency 108.521 ms 2024-02-19T22:14:15.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 125175 48.16 MB/sec execute 20 sec latency 350.418 ms 2024-02-19T22:14:16.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 70019 25.07 MB/sec execute 24 sec latency 125.405 ms 2024-02-19T22:14:16.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:14.604875+0000 mgr.smithi099.zfglya (mgr.14180) 735 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 429 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 17 KiB/s rd, 12 MiB/s wr, 560 op/s 2024-02-19T22:14:16.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:14:15.552410+0000 mon.smithi099 (mon.0) 806 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:14:16.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:14:16.012823+0000 mon.smithi099 (mon.0) 807 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:14:16.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:14:16.013535+0000 mon.smithi099 (mon.0) 808 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:14:16.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:14:16.022133+0000 mon.smithi099 (mon.0) 809 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:14:16.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:14.604875+0000 mgr.smithi099.zfglya (mgr.14180) 735 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 429 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 17 KiB/s rd, 12 MiB/s wr, 560 op/s 2024-02-19T22:14:16.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:14:15.552410+0000 mon.smithi099 (mon.0) 806 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:14:16.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:14:16.012823+0000 mon.smithi099 (mon.0) 807 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:14:16.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:14:16.013535+0000 mon.smithi099 (mon.0) 808 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:14:16.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:14:16.022133+0000 mon.smithi099 (mon.0) 809 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:14:16.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 125824 47.90 MB/sec execute 21 sec latency 496.589 ms 2024-02-19T22:14:17.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 70636 26.08 MB/sec execute 25 sec latency 21.974 ms 2024-02-19T22:14:17.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 125977 45.78 MB/sec execute 22 sec latency 579.494 ms 2024-02-19T22:14:18.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 71123 26.48 MB/sec execute 26 sec latency 58.729 ms 2024-02-19T22:14:18.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:16.605393+0000 mgr.smithi099.zfglya (mgr.14180) 736 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 417 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 541 op/s 2024-02-19T22:14:18.553 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:16.605393+0000 mgr.smithi099.zfglya (mgr.14180) 736 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 417 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 541 op/s 2024-02-19T22:14:18.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 126079 43.82 MB/sec execute 23 sec latency 635.092 ms 2024-02-19T22:14:19.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 71523 26.18 MB/sec execute 27 sec latency 84.537 ms 2024-02-19T22:14:19.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 126551 42.65 MB/sec execute 24 sec latency 690.282 ms 2024-02-19T22:14:20.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 71925 25.68 MB/sec execute 28 sec latency 87.880 ms 2024-02-19T22:14:20.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:18.605935+0000 mgr.smithi099.zfglya (mgr.14180) 737 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 410 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 11 MiB/s wr, 601 op/s 2024-02-19T22:14:20.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:18.605935+0000 mgr.smithi099.zfglya (mgr.14180) 737 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 410 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 11 MiB/s wr, 601 op/s 2024-02-19T22:14:20.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 128050 45.10 MB/sec execute 25 sec latency 115.283 ms 2024-02-19T22:14:21.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 72357 25.40 MB/sec execute 29 sec latency 118.547 ms 2024-02-19T22:14:21.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 128530 44.23 MB/sec execute 26 sec latency 92.249 ms 2024-02-19T22:14:22.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 72797 25.38 MB/sec execute 30 sec latency 113.439 ms 2024-02-19T22:14:22.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:20.606485+0000 mgr.smithi099.zfglya (mgr.14180) 738 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 422 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 12 KiB/s rd, 13 MiB/s wr, 561 op/s 2024-02-19T22:14:22.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:20.606485+0000 mgr.smithi099.zfglya (mgr.14180) 738 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 422 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 12 KiB/s rd, 13 MiB/s wr, 561 op/s 2024-02-19T22:14:22.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 129367 44.34 MB/sec execute 27 sec latency 105.573 ms 2024-02-19T22:14:23.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 73290 25.11 MB/sec execute 31 sec latency 94.803 ms 2024-02-19T22:14:23.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 130718 45.38 MB/sec execute 28 sec latency 118.196 ms 2024-02-19T22:14:24.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 73834 25.37 MB/sec execute 32 sec latency 80.545 ms 2024-02-19T22:14:24.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:22.607044+0000 mgr.smithi099.zfglya (mgr.14180) 739 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 423 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 534 op/s 2024-02-19T22:14:24.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:22.607044+0000 mgr.smithi099.zfglya (mgr.14180) 739 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 423 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 534 op/s 2024-02-19T22:14:24.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 131991 46.18 MB/sec execute 29 sec latency 148.537 ms 2024-02-19T22:14:25.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 74466 26.15 MB/sec execute 33 sec latency 69.812 ms 2024-02-19T22:14:25.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 132161 44.77 MB/sec execute 30 sec latency 125.340 ms 2024-02-19T22:14:26.092 INFO:tasks.workunit.client.1.smithi138.stdout: 10 74847 26.17 MB/sec execute 34 sec latency 72.774 ms 2024-02-19T22:14:26.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:24.607468+0000 mgr.smithi099.zfglya (mgr.14180) 740 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 418 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 10 MiB/s wr, 504 op/s 2024-02-19T22:14:26.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:24.607468+0000 mgr.smithi099.zfglya (mgr.14180) 740 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 418 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 10 MiB/s wr, 504 op/s 2024-02-19T22:14:26.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 133170 44.85 MB/sec execute 31 sec latency 125.472 ms 2024-02-19T22:14:27.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 75165 25.69 MB/sec execute 35 sec latency 107.299 ms 2024-02-19T22:14:27.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 134578 46.26 MB/sec execute 32 sec latency 116.022 ms 2024-02-19T22:14:28.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 75520 25.33 MB/sec execute 36 sec latency 114.596 ms 2024-02-19T22:14:28.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:26.608050+0000 mgr.smithi099.zfglya (mgr.14180) 741 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 416 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 16 KiB/s rd, 12 MiB/s wr, 486 op/s 2024-02-19T22:14:28.702 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:26.608050+0000 mgr.smithi099.zfglya (mgr.14180) 741 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 416 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 16 KiB/s rd, 12 MiB/s wr, 486 op/s 2024-02-19T22:14:28.767 INFO:tasks.workunit.client.0.smithi099.stdout: 10 135561 46.40 MB/sec execute 33 sec latency 100.607 ms 2024-02-19T22:14:29.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 75907 25.05 MB/sec execute 37 sec latency 89.022 ms 2024-02-19T22:14:29.768 INFO:tasks.workunit.client.0.smithi099.stdout: 10 136110 45.94 MB/sec execute 34 sec latency 106.333 ms 2024-02-19T22:14:30.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 76255 24.87 MB/sec execute 38 sec latency 109.464 ms 2024-02-19T22:14:30.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:28.608662+0000 mgr.smithi099.zfglya (mgr.14180) 742 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 418 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 534 op/s 2024-02-19T22:14:30.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:28.608662+0000 mgr.smithi099.zfglya (mgr.14180) 742 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 418 MiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 534 op/s 2024-02-19T22:14:30.769 INFO:tasks.workunit.client.0.smithi099.stdout: 10 136712 45.19 MB/sec execute 35 sec latency 366.661 ms 2024-02-19T22:14:31.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 76733 24.72 MB/sec execute 39 sec latency 38.639 ms 2024-02-19T22:14:31.768 INFO:tasks.workunit.client.0.smithi099.stdout: 10 138119 46.43 MB/sec execute 36 sec latency 227.709 ms 2024-02-19T22:14:32.091 INFO:tasks.workunit.client.1.smithi138.stdout: 10 77256 24.82 MB/sec execute 40 sec latency 65.539 ms 2024-02-19T22:14:32.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:30.609151+0000 mgr.smithi099.zfglya (mgr.14180) 743 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 409 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 458 op/s 2024-02-19T22:14:32.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:30.609151+0000 mgr.smithi099.zfglya (mgr.14180) 743 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 409 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 458 op/s 2024-02-19T22:14:32.768 INFO:tasks.workunit.client.0.smithi099.stdout: 10 139109 46.55 MB/sec execute 37 sec latency 107.064 ms 2024-02-19T22:14:33.092 INFO:tasks.workunit.client.1.smithi138.stdout: 10 77837 25.41 MB/sec execute 41 sec latency 70.566 ms 2024-02-19T22:14:33.769 INFO:tasks.workunit.client.0.smithi099.stdout: 10 139828 46.55 MB/sec execute 38 sec latency 88.438 ms 2024-02-19T22:14:34.092 INFO:tasks.workunit.client.1.smithi138.stdout: 10 78258 25.47 MB/sec execute 42 sec latency 59.892 ms 2024-02-19T22:14:34.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:32.609659+0000 mgr.smithi099.zfglya (mgr.14180) 744 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 409 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 561 op/s 2024-02-19T22:14:34.702 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:32.609659+0000 mgr.smithi099.zfglya (mgr.14180) 744 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 409 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 561 op/s 2024-02-19T22:14:34.769 INFO:tasks.workunit.client.0.smithi099.stdout: 10 141135 46.89 MB/sec execute 39 sec latency 119.270 ms 2024-02-19T22:14:35.092 INFO:tasks.workunit.client.1.smithi138.stdout: 10 78669 25.35 MB/sec execute 43 sec latency 82.245 ms 2024-02-19T22:14:35.769 INFO:tasks.workunit.client.0.smithi099.stdout: 10 142594 47.80 MB/sec execute 40 sec latency 152.482 ms 2024-02-19T22:14:36.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 79085 25.14 MB/sec execute 44 sec latency 99.687 ms 2024-02-19T22:14:36.546 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:34.610161+0000 mgr.smithi099.zfglya (mgr.14180) 745 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 406 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 10 MiB/s wr, 523 op/s 2024-02-19T22:14:36.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:34.610161+0000 mgr.smithi099.zfglya (mgr.14180) 745 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 406 MiB data, 4.6 GiB used, 711 GiB / 715 GiB avail; 21 KiB/s rd, 10 MiB/s wr, 523 op/s 2024-02-19T22:14:36.769 INFO:tasks.workunit.client.0.smithi099.stdout: 10 142721 46.71 MB/sec execute 41 sec latency 86.918 ms 2024-02-19T22:14:37.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 79486 24.90 MB/sec execute 45 sec latency 93.033 ms 2024-02-19T22:14:37.769 INFO:tasks.workunit.client.0.smithi099.stdout: 10 143803 46.76 MB/sec execute 42 sec latency 133.234 ms 2024-02-19T22:14:38.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 79915 24.89 MB/sec execute 46 sec latency 125.619 ms 2024-02-19T22:14:38.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:36.611505+0000 mgr.smithi099.zfglya (mgr.14180) 746 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 415 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 478 op/s 2024-02-19T22:14:38.705 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:36.611505+0000 mgr.smithi099.zfglya (mgr.14180) 746 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 415 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 478 op/s 2024-02-19T22:14:38.769 INFO:tasks.workunit.client.0.smithi099.stdout: 10 145104 47.51 MB/sec execute 43 sec latency 124.866 ms 2024-02-19T22:14:39.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 80408 24.76 MB/sec execute 47 sec latency 64.313 ms 2024-02-19T22:14:39.769 INFO:tasks.workunit.client.0.smithi099.stdout: 10 146198 47.83 MB/sec execute 44 sec latency 91.848 ms 2024-02-19T22:14:40.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 80902 24.81 MB/sec execute 48 sec latency 72.675 ms 2024-02-19T22:14:40.546 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:38.612045+0000 mgr.smithi099.zfglya (mgr.14180) 747 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 427 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 20 KiB/s rd, 11 MiB/s wr, 591 op/s 2024-02-19T22:14:40.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:38.612045+0000 mgr.smithi099.zfglya (mgr.14180) 747 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 427 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 20 KiB/s rd, 11 MiB/s wr, 591 op/s 2024-02-19T22:14:40.769 INFO:tasks.workunit.client.0.smithi099.stdout: 10 146449 46.90 MB/sec execute 45 sec latency 93.874 ms 2024-02-19T22:14:41.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 81489 25.30 MB/sec execute 49 sec latency 66.318 ms 2024-02-19T22:14:41.769 INFO:tasks.workunit.client.0.smithi099.stdout: 10 147837 47.20 MB/sec execute 46 sec latency 310.726 ms 2024-02-19T22:14:42.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 81959 25.46 MB/sec execute 50 sec latency 65.262 ms 2024-02-19T22:14:42.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:40.612585+0000 mgr.smithi099.zfglya (mgr.14180) 748 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 420 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 15 KiB/s rd, 12 MiB/s wr, 556 op/s 2024-02-19T22:14:42.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:40.612585+0000 mgr.smithi099.zfglya (mgr.14180) 748 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 420 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 15 KiB/s rd, 12 MiB/s wr, 556 op/s 2024-02-19T22:14:42.769 INFO:tasks.workunit.client.0.smithi099.stdout: 10 149383 48.64 MB/sec execute 47 sec latency 118.547 ms 2024-02-19T22:14:43.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 82380 25.26 MB/sec execute 51 sec latency 87.266 ms 2024-02-19T22:14:43.769 INFO:tasks.workunit.client.0.smithi099.stdout: 10 149801 47.86 MB/sec execute 48 sec latency 138.409 ms 2024-02-19T22:14:44.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 82814 25.02 MB/sec execute 52 sec latency 106.093 ms 2024-02-19T22:14:44.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:42.613136+0000 mgr.smithi099.zfglya (mgr.14180) 749 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 416 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 15 KiB/s rd, 12 MiB/s wr, 580 op/s 2024-02-19T22:14:44.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:42.613136+0000 mgr.smithi099.zfglya (mgr.14180) 749 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 416 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 15 KiB/s rd, 12 MiB/s wr, 580 op/s 2024-02-19T22:14:44.769 INFO:tasks.workunit.client.0.smithi099.stdout: 10 150638 47.84 MB/sec execute 49 sec latency 107.954 ms 2024-02-19T22:14:45.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 83274 24.97 MB/sec execute 53 sec latency 130.471 ms 2024-02-19T22:14:45.771 INFO:tasks.workunit.client.0.smithi099.stdout: 10 151990 48.36 MB/sec execute 50 sec latency 126.852 ms 2024-02-19T22:14:46.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 83719 24.87 MB/sec execute 54 sec latency 93.748 ms 2024-02-19T22:14:46.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:44.616294+0000 mgr.smithi099.zfglya (mgr.14180) 750 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 427 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 20 KiB/s rd, 11 MiB/s wr, 546 op/s 2024-02-19T22:14:46.702 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:44.616294+0000 mgr.smithi099.zfglya (mgr.14180) 750 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 427 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 20 KiB/s rd, 11 MiB/s wr, 546 op/s 2024-02-19T22:14:46.771 INFO:tasks.workunit.client.0.smithi099.stdout: 10 153285 48.76 MB/sec execute 51 sec latency 92.316 ms 2024-02-19T22:14:47.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 84287 24.94 MB/sec execute 55 sec latency 98.528 ms 2024-02-19T22:14:47.773 INFO:tasks.workunit.client.0.smithi099.stdout: 10 153357 47.85 MB/sec execute 52 sec latency 358.668 ms 2024-02-19T22:14:48.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 84879 25.34 MB/sec execute 56 sec latency 61.065 ms 2024-02-19T22:14:48.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:46.616812+0000 mgr.smithi099.zfglya (mgr.14180) 751 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 428 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 13 MiB/s wr, 576 op/s 2024-02-19T22:14:48.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:46.616812+0000 mgr.smithi099.zfglya (mgr.14180) 751 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 428 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 13 KiB/s rd, 13 MiB/s wr, 576 op/s 2024-02-19T22:14:48.771 INFO:tasks.workunit.client.0.smithi099.stdout: 10 154426 47.88 MB/sec execute 53 sec latency 108.933 ms 2024-02-19T22:14:49.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 85367 25.48 MB/sec execute 57 sec latency 73.253 ms 2024-02-19T22:14:49.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 155743 48.46 MB/sec execute 54 sec latency 108.766 ms 2024-02-19T22:14:50.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 85736 25.38 MB/sec execute 58 sec latency 98.551 ms 2024-02-19T22:14:50.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:48.617433+0000 mgr.smithi099.zfglya (mgr.14180) 752 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 416 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 623 op/s 2024-02-19T22:14:50.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:48.617433+0000 mgr.smithi099.zfglya (mgr.14180) 752 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 416 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 22 KiB/s rd, 12 MiB/s wr, 623 op/s 2024-02-19T22:14:50.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 156831 48.69 MB/sec execute 55 sec latency 96.335 ms 2024-02-19T22:14:51.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 86166 25.23 MB/sec execute 59 sec latency 53.233 ms 2024-02-19T22:14:51.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 157082 47.93 MB/sec execute 56 sec latency 106.378 ms 2024-02-19T22:14:52.095 INFO:tasks.workunit.client.1.smithi138.stdout: 10 86542 24.99 MB/sec execute 60 sec latency 120.848 ms 2024-02-19T22:14:52.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:50.618001+0000 mgr.smithi099.zfglya (mgr.14180) 753 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 416 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 511 op/s 2024-02-19T22:14:52.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:50.618001+0000 mgr.smithi099.zfglya (mgr.14180) 753 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 416 MiB data, 4.9 GiB used, 710 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 511 op/s 2024-02-19T22:14:52.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 158471 48.15 MB/sec execute 57 sec latency 217.429 ms 2024-02-19T22:14:53.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 86929 24.89 MB/sec execute 61 sec latency 156.623 ms 2024-02-19T22:14:53.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 158715 47.73 MB/sec execute 58 sec latency 437.600 ms 2024-02-19T22:14:54.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 87365 24.85 MB/sec execute 62 sec latency 101.238 ms 2024-02-19T22:14:54.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:52.619624+0000 mgr.smithi099.zfglya (mgr.14180) 754 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 418 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 505 op/s 2024-02-19T22:14:54.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:52.619624+0000 mgr.smithi099.zfglya (mgr.14180) 754 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 418 MiB data, 5.0 GiB used, 710 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 505 op/s 2024-02-19T22:14:54.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 158958 47.33 MB/sec execute 59 sec latency 698.101 ms 2024-02-19T22:14:55.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 87951 25.00 MB/sec execute 63 sec latency 61.011 ms 2024-02-19T22:14:55.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 159081 46.67 MB/sec execute 60 sec latency 586.271 ms 2024-02-19T22:14:56.094 INFO:tasks.workunit.client.1.smithi138.stdout: 10 88441 25.22 MB/sec execute 64 sec latency 69.058 ms 2024-02-19T22:14:56.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:54.620109+0000 mgr.smithi099.zfglya (mgr.14180) 755 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 420 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 22 KiB/s rd, 11 MiB/s wr, 556 op/s 2024-02-19T22:14:56.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:54.620109+0000 mgr.smithi099.zfglya (mgr.14180) 755 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 420 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 22 KiB/s rd, 11 MiB/s wr, 556 op/s 2024-02-19T22:14:56.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 159387 46.20 MB/sec execute 61 sec latency 517.635 ms 2024-02-19T22:14:57.095 INFO:tasks.workunit.client.1.smithi138.stdout: 10 88856 25.26 MB/sec execute 65 sec latency 54.794 ms 2024-02-19T22:14:57.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 160374 46.28 MB/sec execute 62 sec latency 404.382 ms 2024-02-19T22:14:58.095 INFO:tasks.workunit.client.1.smithi138.stdout: 10 89155 25.13 MB/sec execute 66 sec latency 110.812 ms 2024-02-19T22:14:58.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:14:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:56.622086+0000 mgr.smithi099.zfglya (mgr.14180) 756 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 413 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 17 KiB/s rd, 12 MiB/s wr, 518 op/s 2024-02-19T22:14:58.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:14:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:56.622086+0000 mgr.smithi099.zfglya (mgr.14180) 756 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 413 MiB data, 5.2 GiB used, 710 GiB / 715 GiB avail; 17 KiB/s rd, 12 MiB/s wr, 518 op/s 2024-02-19T22:14:58.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 160597 45.63 MB/sec execute 63 sec latency 76.213 ms 2024-02-19T22:14:59.095 INFO:tasks.workunit.client.1.smithi138.stdout: 10 89508 24.94 MB/sec execute 67 sec latency 33.397 ms 2024-02-19T22:14:59.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 162037 45.88 MB/sec execute 64 sec latency 129.841 ms 2024-02-19T22:15:00.095 INFO:tasks.workunit.client.1.smithi138.stdout: 10 89923 24.77 MB/sec execute 68 sec latency 83.862 ms 2024-02-19T22:15:00.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:14:58.622601+0000 mgr.smithi099.zfglya (mgr.14180) 757 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 411 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 23 KiB/s rd, 11 MiB/s wr, 524 op/s 2024-02-19T22:15:00.702 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:14:58.622601+0000 mgr.smithi099.zfglya (mgr.14180) 757 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 411 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 23 KiB/s rd, 11 MiB/s wr, 524 op/s 2024-02-19T22:15:00.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 163861 47.06 MB/sec execute 65 sec latency 109.298 ms 2024-02-19T22:15:01.095 INFO:tasks.workunit.client.1.smithi138.stdout: 10 90371 24.73 MB/sec execute 69 sec latency 84.064 ms 2024-02-19T22:15:01.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 163990 46.39 MB/sec execute 66 sec latency 94.639 ms 2024-02-19T22:15:02.095 INFO:tasks.workunit.client.1.smithi138.stdout: 10 90793 24.66 MB/sec execute 70 sec latency 105.568 ms 2024-02-19T22:15:02.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:00.623176+0000 mgr.smithi099.zfglya (mgr.14180) 758 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 416 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 475 op/s 2024-02-19T22:15:02.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:00.623176+0000 mgr.smithi099.zfglya (mgr.14180) 758 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 416 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 475 op/s 2024-02-19T22:15:02.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 164176 45.77 MB/sec execute 67 sec latency 294.511 ms 2024-02-19T22:15:03.095 INFO:tasks.workunit.client.1.smithi138.stdout: 10 91357 24.66 MB/sec execute 71 sec latency 27.906 ms 2024-02-19T22:15:03.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 165636 46.06 MB/sec execute 68 sec latency 318.478 ms 2024-02-19T22:15:04.095 INFO:tasks.workunit.client.1.smithi138.stdout: 10 91976 25.06 MB/sec execute 72 sec latency 78.225 ms 2024-02-19T22:15:04.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:02.623608+0000 mgr.smithi099.zfglya (mgr.14180) 759 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 423 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 554 op/s 2024-02-19T22:15:04.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:02.623608+0000 mgr.smithi099.zfglya (mgr.14180) 759 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 423 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 554 op/s 2024-02-19T22:15:04.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 167411 47.10 MB/sec execute 69 sec latency 113.460 ms 2024-02-19T22:15:05.095 INFO:tasks.workunit.client.1.smithi138.stdout: 10 92466 25.15 MB/sec execute 73 sec latency 66.627 ms 2024-02-19T22:15:05.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 167538 46.47 MB/sec execute 70 sec latency 101.356 ms 2024-02-19T22:15:06.095 INFO:tasks.workunit.client.1.smithi138.stdout: 10 92863 25.10 MB/sec execute 74 sec latency 73.710 ms 2024-02-19T22:15:06.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:04.624105+0000 mgr.smithi099.zfglya (mgr.14180) 760 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 415 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 21 KiB/s rd, 10 MiB/s wr, 573 op/s 2024-02-19T22:15:06.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:04.624105+0000 mgr.smithi099.zfglya (mgr.14180) 760 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 415 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 21 KiB/s rd, 10 MiB/s wr, 573 op/s 2024-02-19T22:15:06.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 168460 46.49 MB/sec execute 71 sec latency 112.007 ms 2024-02-19T22:15:07.095 INFO:tasks.workunit.client.1.smithi138.stdout: 10 93169 24.85 MB/sec execute 75 sec latency 71.281 ms 2024-02-19T22:15:07.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 169827 46.91 MB/sec execute 72 sec latency 118.958 ms 2024-02-19T22:15:08.099 INFO:tasks.workunit.client.1.smithi138.stdout: 10 93443 24.68 MB/sec execute 76 sec latency 142.635 ms 2024-02-19T22:15:08.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:06.624690+0000 mgr.smithi099.zfglya (mgr.14180) 761 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 411 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 501 op/s 2024-02-19T22:15:08.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:06.624690+0000 mgr.smithi099.zfglya (mgr.14180) 761 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 411 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 501 op/s 2024-02-19T22:15:08.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 171008 47.16 MB/sec execute 73 sec latency 101.783 ms 2024-02-19T22:15:09.098 INFO:tasks.workunit.client.1.smithi138.stdout: 10 93940 24.65 MB/sec execute 77 sec latency 98.751 ms 2024-02-19T22:15:09.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 171262 46.60 MB/sec execute 74 sec latency 93.027 ms 2024-02-19T22:15:10.100 INFO:tasks.workunit.client.1.smithi138.stdout: 10 94376 24.61 MB/sec execute 78 sec latency 141.211 ms 2024-02-19T22:15:10.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:08.625200+0000 mgr.smithi099.zfglya (mgr.14180) 762 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 416 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 22 KiB/s rd, 11 MiB/s wr, 491 op/s 2024-02-19T22:15:10.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:08.625200+0000 mgr.smithi099.zfglya (mgr.14180) 762 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 416 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 22 KiB/s rd, 11 MiB/s wr, 491 op/s 2024-02-19T22:15:10.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 172752 46.89 MB/sec execute 75 sec latency 109.268 ms 2024-02-19T22:15:11.099 INFO:tasks.workunit.client.1.smithi138.stdout: 10 94815 24.56 MB/sec execute 79 sec latency 80.550 ms 2024-02-19T22:15:11.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 174503 47.80 MB/sec execute 76 sec latency 115.869 ms 2024-02-19T22:15:12.099 INFO:tasks.workunit.client.1.smithi138.stdout: 10 95258 24.65 MB/sec execute 80 sec latency 79.465 ms 2024-02-19T22:15:12.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:10.625711+0000 mgr.smithi099.zfglya (mgr.14180) 763 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 412 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 16 KiB/s rd, 12 MiB/s wr, 525 op/s 2024-02-19T22:15:12.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:10.625711+0000 mgr.smithi099.zfglya (mgr.14180) 763 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 412 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 16 KiB/s rd, 12 MiB/s wr, 525 op/s 2024-02-19T22:15:12.772 INFO:tasks.workunit.client.0.smithi099.stdout: 10 174630 47.22 MB/sec execute 77 sec latency 106.249 ms 2024-02-19T22:15:13.100 INFO:tasks.workunit.client.1.smithi138.stdout: 10 95767 24.81 MB/sec execute 81 sec latency 58.974 ms 2024-02-19T22:15:13.773 INFO:tasks.workunit.client.0.smithi099.stdout: 10 175430 47.21 MB/sec execute 78 sec latency 302.490 ms 2024-02-19T22:15:14.100 INFO:tasks.workunit.client.1.smithi138.stdout: 10 96212 24.88 MB/sec execute 82 sec latency 79.162 ms 2024-02-19T22:15:14.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:12.626213+0000 mgr.smithi099.zfglya (mgr.14180) 764 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 407 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 16 KiB/s rd, 11 MiB/s wr, 603 op/s 2024-02-19T22:15:14.703 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:12.626213+0000 mgr.smithi099.zfglya (mgr.14180) 764 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 407 MiB data, 5.4 GiB used, 710 GiB / 715 GiB avail; 16 KiB/s rd, 11 MiB/s wr, 603 op/s 2024-02-19T22:15:14.773 INFO:tasks.workunit.client.0.smithi099.stdout: 10 176815 47.55 MB/sec execute 79 sec latency 113.084 ms 2024-02-19T22:15:15.100 INFO:tasks.workunit.client.1.smithi138.stdout: 10 96550 24.73 MB/sec execute 83 sec latency 130.422 ms 2024-02-19T22:15:15.773 INFO:tasks.workunit.client.0.smithi099.stdout: 10 178099 47.81 MB/sec execute 80 sec latency 121.432 ms 2024-02-19T22:15:16.100 INFO:tasks.workunit.client.1.smithi138.stdout: 10 97017 24.61 MB/sec execute 84 sec latency 31.752 ms 2024-02-19T22:15:16.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:14.628973+0000 mgr.smithi099.zfglya (mgr.14180) 765 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 407 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 470 op/s 2024-02-19T22:15:16.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:15:16.029511+0000 mon.smithi099 (mon.0) 810 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:15:16.700 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:14.628973+0000 mgr.smithi099.zfglya (mgr.14180) 765 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 407 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 470 op/s 2024-02-19T22:15:16.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:15:16.029511+0000 mon.smithi099 (mon.0) 810 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:15:16.777 INFO:tasks.workunit.client.0.smithi099.stdout: 10 178291 47.28 MB/sec execute 81 sec latency 95.505 ms 2024-02-19T22:15:17.100 INFO:tasks.workunit.client.1.smithi138.stdout: 10 97400 24.57 MB/sec execute 85 sec latency 132.332 ms 2024-02-19T22:15:17.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:15:16.496081+0000 mon.smithi099 (mon.0) 811 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:15:17.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:15:16.496831+0000 mon.smithi099 (mon.0) 812 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:15:17.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:15:16.501284+0000 mon.smithi099 (mon.0) 813 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:15:17.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:16.629549+0000 mgr.smithi099.zfglya (mgr.14180) 766 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 420 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 431 op/s 2024-02-19T22:15:17.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:15:16.496081+0000 mon.smithi099 (mon.0) 811 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:15:17.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:15:16.496831+0000 mon.smithi099 (mon.0) 812 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:15:17.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:15:16.501284+0000 mon.smithi099 (mon.0) 813 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:15:17.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:16.629549+0000 mgr.smithi099.zfglya (mgr.14180) 766 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 420 MiB data, 5.5 GiB used, 710 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 431 op/s 2024-02-19T22:15:17.776 INFO:tasks.workunit.client.0.smithi099.stdout: 10 179831 47.53 MB/sec execute 82 sec latency 96.849 ms 2024-02-19T22:15:18.100 INFO:tasks.workunit.client.1.smithi138.stdout: 10 97835 24.51 MB/sec execute 86 sec latency 107.465 ms 2024-02-19T22:15:18.777 INFO:tasks.workunit.client.0.smithi099.stdout: 10 181591 48.37 MB/sec execute 83 sec latency 128.487 ms 2024-02-19T22:15:19.100 INFO:tasks.workunit.client.1.smithi138.stdout: 10 98343 24.49 MB/sec execute 87 sec latency 62.835 ms 2024-02-19T22:15:19.777 INFO:tasks.workunit.client.0.smithi099.stdout: 10 181657 47.81 MB/sec execute 84 sec latency 335.509 ms 2024-02-19T22:15:19.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:18.632609+0000 mgr.smithi099.zfglya (mgr.14180) 767 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 421 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 10 MiB/s wr, 492 op/s 2024-02-19T22:15:20.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:18.632609+0000 mgr.smithi099.zfglya (mgr.14180) 767 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 421 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 10 MiB/s wr, 492 op/s 2024-02-19T22:15:20.100 INFO:tasks.workunit.client.1.smithi138.stdout: 10 98774 24.58 MB/sec execute 88 sec latency 80.108 ms 2024-02-19T22:15:20.777 INFO:tasks.workunit.client.0.smithi099.stdout: 10 182520 47.82 MB/sec execute 85 sec latency 118.097 ms 2024-02-19T22:15:21.100 INFO:tasks.workunit.client.1.smithi138.stdout: 10 99250 24.68 MB/sec execute 89 sec latency 84.265 ms 2024-02-19T22:15:21.777 INFO:tasks.workunit.client.0.smithi099.stdout: 10 183907 48.12 MB/sec execute 86 sec latency 106.833 ms 2024-02-19T22:15:21.950 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:20.633073+0000 mgr.smithi099.zfglya (mgr.14180) 768 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 417 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 528 op/s 2024-02-19T22:15:22.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:20.633073+0000 mgr.smithi099.zfglya (mgr.14180) 768 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 417 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 528 op/s 2024-02-19T22:15:22.100 INFO:tasks.workunit.client.1.smithi138.stdout: 10 99657 24.70 MB/sec execute 90 sec latency 81.658 ms 2024-02-19T22:15:22.777 INFO:tasks.workunit.client.0.smithi099.stdout: 10 185189 48.36 MB/sec execute 87 sec latency 91.783 ms 2024-02-19T22:15:23.101 INFO:tasks.workunit.client.1.smithi138.stdout: 10 100080 24.66 MB/sec execute 91 sec latency 75.287 ms 2024-02-19T22:15:23.777 INFO:tasks.workunit.client.0.smithi099.stdout: 10 185381 47.86 MB/sec execute 88 sec latency 92.272 ms 2024-02-19T22:15:23.952 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:22.633626+0000 mgr.smithi099.zfglya (mgr.14180) 769 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 419 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 533 op/s 2024-02-19T22:15:24.044 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:22.633626+0000 mgr.smithi099.zfglya (mgr.14180) 769 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 419 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 533 op/s 2024-02-19T22:15:24.101 INFO:tasks.workunit.client.1.smithi138.stdout: 10 100443 24.51 MB/sec execute 92 sec latency 119.340 ms 2024-02-19T22:15:24.778 INFO:tasks.workunit.client.0.smithi099.stdout: 10 186911 48.08 MB/sec execute 89 sec latency 179.342 ms 2024-02-19T22:15:25.101 INFO:tasks.workunit.client.1.smithi138.stdout: 10 100779 24.37 MB/sec execute 93 sec latency 113.216 ms 2024-02-19T22:15:25.778 INFO:tasks.workunit.client.0.smithi099.stdout: 10 188594 48.80 MB/sec execute 90 sec latency 150.445 ms 2024-02-19T22:15:25.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:24.634074+0000 mgr.smithi099.zfglya (mgr.14180) 770 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 419 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 17 KiB/s rd, 10 MiB/s wr, 433 op/s 2024-02-19T22:15:26.101 INFO:tasks.workunit.client.1.smithi138.stdout: 10 101165 24.36 MB/sec execute 94 sec latency 136.089 ms 2024-02-19T22:15:26.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:24.634074+0000 mgr.smithi099.zfglya (mgr.14180) 770 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 419 MiB data, 5.7 GiB used, 709 GiB / 715 GiB avail; 17 KiB/s rd, 10 MiB/s wr, 433 op/s 2024-02-19T22:15:26.778 INFO:tasks.workunit.client.0.smithi099.stdout: 10 188810 48.35 MB/sec execute 91 sec latency 100.233 ms 2024-02-19T22:15:27.101 INFO:tasks.workunit.client.1.smithi138.stdout: 10 101614 24.31 MB/sec execute 95 sec latency 114.268 ms 2024-02-19T22:15:27.778 INFO:tasks.workunit.client.0.smithi099.stdout: 10 189846 48.36 MB/sec execute 92 sec latency 109.786 ms 2024-02-19T22:15:28.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:26.634659+0000 mgr.smithi099.zfglya (mgr.14180) 771 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 421 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 515 op/s 2024-02-19T22:15:28.101 INFO:tasks.workunit.client.1.smithi138.stdout: 10 102113 24.33 MB/sec execute 96 sec latency 69.747 ms 2024-02-19T22:15:28.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:26.634659+0000 mgr.smithi099.zfglya (mgr.14180) 771 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 421 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 515 op/s 2024-02-19T22:15:28.778 INFO:tasks.workunit.client.0.smithi099.stdout: 10 191160 48.67 MB/sec execute 93 sec latency 133.409 ms 2024-02-19T22:15:29.101 INFO:tasks.workunit.client.1.smithi138.stdout: 10 102696 24.57 MB/sec execute 97 sec latency 73.313 ms 2024-02-19T22:15:29.778 INFO:tasks.workunit.client.0.smithi099.stdout: 10 192233 48.81 MB/sec execute 94 sec latency 291.652 ms 2024-02-19T22:15:30.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:28.635274+0000 mgr.smithi099.zfglya (mgr.14180) 772 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 418 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 10 MiB/s wr, 552 op/s 2024-02-19T22:15:30.101 INFO:tasks.workunit.client.1.smithi138.stdout: 10 103078 24.58 MB/sec execute 98 sec latency 108.196 ms 2024-02-19T22:15:30.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:28.635274+0000 mgr.smithi099.zfglya (mgr.14180) 772 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 418 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 10 MiB/s wr, 552 op/s 2024-02-19T22:15:30.779 INFO:tasks.workunit.client.0.smithi099.stdout: 10 192282 48.31 MB/sec execute 95 sec latency 424.762 ms 2024-02-19T22:15:31.101 INFO:tasks.workunit.client.1.smithi138.stdout: 10 103495 24.56 MB/sec execute 99 sec latency 34.437 ms 2024-02-19T22:15:31.779 INFO:tasks.workunit.client.0.smithi099.stdout: 10 192287 47.81 MB/sec execute 96 sec latency 412.598 ms 2024-02-19T22:15:32.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:30.635872+0000 mgr.smithi099.zfglya (mgr.14180) 773 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 425 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 542 op/s 2024-02-19T22:15:32.101 INFO:tasks.workunit.client.1.smithi138.stdout: 10 103856 24.43 MB/sec execute 100 sec latency 81.399 ms 2024-02-19T22:15:32.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:30.635872+0000 mgr.smithi099.zfglya (mgr.14180) 773 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 425 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 542 op/s 2024-02-19T22:15:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: 10 192330 47.33 MB/sec execute 97 sec latency 467.120 ms 2024-02-19T22:15:33.101 INFO:tasks.workunit.client.1.smithi138.stdout: 10 104169 24.27 MB/sec execute 101 sec latency 107.415 ms 2024-02-19T22:15:33.779 INFO:tasks.workunit.client.0.smithi099.stdout: 10 192355 46.85 MB/sec execute 98 sec latency 400.436 ms 2024-02-19T22:15:34.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:32.636386+0000 mgr.smithi099.zfglya (mgr.14180) 774 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 434 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 557 op/s 2024-02-19T22:15:34.101 INFO:tasks.workunit.client.1.smithi138.stdout: 10 104530 24.20 MB/sec execute 102 sec latency 116.183 ms 2024-02-19T22:15:34.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:32.636386+0000 mgr.smithi099.zfglya (mgr.14180) 774 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 434 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 557 op/s 2024-02-19T22:15:34.779 INFO:tasks.workunit.client.0.smithi099.stdout: 10 193440 46.87 MB/sec execute 99 sec latency 97.334 ms 2024-02-19T22:15:35.102 INFO:tasks.workunit.client.1.smithi138.stdout: 10 104948 24.19 MB/sec execute 103 sec latency 83.145 ms 2024-02-19T22:15:35.762 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:34.636902+0000 mgr.smithi099.zfglya (mgr.14180) 775 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 429 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 18 KiB/s rd, 9.9 MiB/s wr, 476 op/s 2024-02-19T22:15:35.779 INFO:tasks.workunit.client.0.smithi099.stdout: 10 194822 47.28 MB/sec execute 100 sec latency 110.005 ms 2024-02-19T22:15:36.102 INFO:tasks.workunit.client.1.smithi138.stdout: 10 105415 24.13 MB/sec execute 104 sec latency 79.351 ms 2024-02-19T22:15:36.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:34.636902+0000 mgr.smithi099.zfglya (mgr.14180) 775 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 429 MiB data, 5.8 GiB used, 709 GiB / 715 GiB avail; 18 KiB/s rd, 9.9 MiB/s wr, 476 op/s 2024-02-19T22:15:36.779 INFO:tasks.workunit.client.0.smithi099.stdout: 10 195835 47.34 MB/sec execute 101 sec latency 101.111 ms 2024-02-19T22:15:37.102 INFO:tasks.workunit.client.1.smithi138.stdout: 10 105867 24.21 MB/sec execute 105 sec latency 69.814 ms 2024-02-19T22:15:37.779 INFO:tasks.workunit.client.0.smithi099.stdout: 10 196081 46.93 MB/sec execute 102 sec latency 94.274 ms 2024-02-19T22:15:38.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:36.637477+0000 mgr.smithi099.zfglya (mgr.14180) 776 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 417 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 538 op/s 2024-02-19T22:15:38.102 INFO:tasks.workunit.client.1.smithi138.stdout: 10 106478 24.44 MB/sec execute 106 sec latency 62.683 ms 2024-02-19T22:15:38.202 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:36.637477+0000 mgr.smithi099.zfglya (mgr.14180) 776 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 417 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 538 op/s 2024-02-19T22:15:38.779 INFO:tasks.workunit.client.0.smithi099.stdout: 10 197561 47.12 MB/sec execute 103 sec latency 118.054 ms 2024-02-19T22:15:39.102 INFO:tasks.workunit.client.1.smithi138.stdout: 10 106910 24.44 MB/sec execute 107 sec latency 85.075 ms 2024-02-19T22:15:39.779 INFO:tasks.workunit.client.0.smithi099.stdout: 10 199316 47.79 MB/sec execute 104 sec latency 116.384 ms 2024-02-19T22:15:40.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:38.638037+0000 mgr.smithi099.zfglya (mgr.14180) 777 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 415 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 9.9 MiB/s wr, 513 op/s 2024-02-19T22:15:40.102 INFO:tasks.workunit.client.1.smithi138.stdout: 10 107236 24.32 MB/sec execute 108 sec latency 132.364 ms 2024-02-19T22:15:40.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:38.638037+0000 mgr.smithi099.zfglya (mgr.14180) 777 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 415 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 9.9 MiB/s wr, 513 op/s 2024-02-19T22:15:40.779 INFO:tasks.workunit.client.0.smithi099.stdout: 10 199445 47.37 MB/sec execute 105 sec latency 84.792 ms 2024-02-19T22:15:41.102 INFO:tasks.workunit.client.1.smithi138.stdout: 10 107565 24.21 MB/sec execute 109 sec latency 88.523 ms 2024-02-19T22:15:41.780 INFO:tasks.workunit.client.0.smithi099.stdout: 10 200506 47.38 MB/sec execute 106 sec latency 99.098 ms 2024-02-19T22:15:42.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:40.638538+0000 mgr.smithi099.zfglya (mgr.14180) 778 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 421 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 534 op/s 2024-02-19T22:15:42.102 INFO:tasks.workunit.client.1.smithi138.stdout: 10 107900 24.11 MB/sec execute 110 sec latency 108.614 ms 2024-02-19T22:15:42.203 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:40.638538+0000 mgr.smithi099.zfglya (mgr.14180) 778 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 421 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 534 op/s 2024-02-19T22:15:42.780 INFO:tasks.workunit.client.0.smithi099.stdout: 10 201793 47.67 MB/sec execute 107 sec latency 121.747 ms 2024-02-19T22:15:43.102 INFO:tasks.workunit.client.1.smithi138.stdout: 10 108315 24.11 MB/sec execute 111 sec latency 100.055 ms 2024-02-19T22:15:43.780 INFO:tasks.workunit.client.0.smithi099.stdout: 10 202922 47.81 MB/sec execute 108 sec latency 104.240 ms 2024-02-19T22:15:44.043 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:42.641054+0000 mgr.smithi099.zfglya (mgr.14180) 779 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 433 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 537 op/s 2024-02-19T22:15:44.102 INFO:tasks.workunit.client.1.smithi138.stdout: 10 108793 24.07 MB/sec execute 112 sec latency 83.190 ms 2024-02-19T22:15:44.202 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:42.641054+0000 mgr.smithi099.zfglya (mgr.14180) 779 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 433 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 537 op/s 2024-02-19T22:15:44.780 INFO:tasks.workunit.client.0.smithi099.stdout: 10 203064 47.40 MB/sec execute 109 sec latency 272.106 ms 2024-02-19T22:15:45.102 INFO:tasks.workunit.client.1.smithi138.stdout: 10 109302 24.12 MB/sec execute 113 sec latency 69.489 ms 2024-02-19T22:15:45.780 INFO:tasks.workunit.client.0.smithi099.stdout: 10 204396 47.50 MB/sec execute 110 sec latency 121.206 ms 2024-02-19T22:15:46.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:44.641454+0000 mgr.smithi099.zfglya (mgr.14180) 780 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 428 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 9.0 MiB/s wr, 437 op/s 2024-02-19T22:15:46.102 INFO:tasks.workunit.client.1.smithi138.stdout: 10 109843 24.29 MB/sec execute 114 sec latency 81.823 ms 2024-02-19T22:15:46.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:44.641454+0000 mgr.smithi099.zfglya (mgr.14180) 780 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 428 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 9.0 MiB/s wr, 437 op/s 2024-02-19T22:15:46.780 INFO:tasks.workunit.client.0.smithi099.stdout: 10 205505 47.78 MB/sec execute 111 sec latency 115.096 ms 2024-02-19T22:15:47.102 INFO:tasks.workunit.client.1.smithi138.stdout: 10 110281 24.29 MB/sec execute 115 sec latency 91.144 ms 2024-02-19T22:15:47.780 INFO:tasks.workunit.client.0.smithi099.stdout: 10 206472 47.81 MB/sec execute 112 sec latency 116.796 ms 2024-02-19T22:15:48.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:46.641961+0000 mgr.smithi099.zfglya (mgr.14180) 781 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 424 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 15 KiB/s rd, 11 MiB/s wr, 477 op/s 2024-02-19T22:15:48.102 INFO:tasks.workunit.client.1.smithi138.stdout: 10 110683 24.27 MB/sec execute 116 sec latency 103.943 ms 2024-02-19T22:15:48.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:46.641961+0000 mgr.smithi099.zfglya (mgr.14180) 781 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 424 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 15 KiB/s rd, 11 MiB/s wr, 477 op/s 2024-02-19T22:15:48.780 INFO:tasks.workunit.client.0.smithi099.stdout: 10 207272 47.77 MB/sec execute 113 sec latency 89.966 ms 2024-02-19T22:15:49.103 INFO:tasks.workunit.client.1.smithi138.stdout: 10 111055 24.18 MB/sec execute 117 sec latency 105.625 ms 2024-02-19T22:15:49.782 INFO:tasks.workunit.client.0.smithi099.stdout: 10 208572 47.97 MB/sec execute 114 sec latency 130.092 ms 2024-02-19T22:15:50.103 INFO:tasks.workunit.client.1.smithi138.stdout: 10 111383 24.08 MB/sec execute 118 sec latency 108.725 ms 2024-02-19T22:15:50.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:48.642623+0000 mgr.smithi099.zfglya (mgr.14180) 782 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 432 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 11 MiB/s wr, 551 op/s 2024-02-19T22:15:50.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:48.642623+0000 mgr.smithi099.zfglya (mgr.14180) 782 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 432 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 11 MiB/s wr, 551 op/s 2024-02-19T22:15:50.781 INFO:tasks.workunit.client.0.smithi099.stdout: 10 209963 48.21 MB/sec execute 115 sec latency 119.376 ms 2024-02-19T22:15:51.103 INFO:tasks.workunit.client.1.smithi138.stdout: 10 111709 24.01 MB/sec execute 119 sec latency 123.469 ms 2024-02-19T22:15:51.782 INFO:tasks.workunit.client.0.smithi099.stdout: 10 210140 47.83 MB/sec execute 116 sec latency 78.988 ms 2024-02-19T22:15:52.103 INFO:tasks.workunit.client.1.smithi138.stdout: 10 112109 23.97 MB/sec execute 120 sec latency 92.587 ms 2024-02-19T22:15:52.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:50.644407+0000 mgr.smithi099.zfglya (mgr.14180) 783 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 432 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 521 op/s 2024-02-19T22:15:52.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:50.644407+0000 mgr.smithi099.zfglya (mgr.14180) 783 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 432 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 521 op/s 2024-02-19T22:15:52.782 INFO:tasks.workunit.client.0.smithi099.stdout: 10 211172 47.83 MB/sec execute 117 sec latency 106.864 ms 2024-02-19T22:15:53.103 INFO:tasks.workunit.client.1.smithi138.stdout: 10 112527 23.92 MB/sec execute 121 sec latency 78.926 ms 2024-02-19T22:15:53.782 INFO:tasks.workunit.client.0.smithi099.stdout: 10 212575 48.19 MB/sec execute 118 sec latency 133.614 ms 2024-02-19T22:15:54.104 INFO:tasks.workunit.client.1.smithi138.stdout: 10 112989 23.99 MB/sec execute 122 sec latency 68.983 ms 2024-02-19T22:15:54.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:52.644958+0000 mgr.smithi099.zfglya (mgr.14180) 784 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 426 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 501 op/s 2024-02-19T22:15:54.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:52.644958+0000 mgr.smithi099.zfglya (mgr.14180) 784 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 426 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 501 op/s 2024-02-19T22:15:54.782 INFO:tasks.workunit.client.0.smithi099.stdout: 10 213552 48.21 MB/sec execute 119 sec latency 262.810 ms 2024-02-19T22:15:55.104 INFO:tasks.workunit.client.1.smithi138.stdout: 10 113423 24.11 MB/sec execute 123 sec latency 74.776 ms 2024-02-19T22:15:55.782 INFO:tasks.workunit.client.0.smithi099.stdout: 10 213629 47.82 MB/sec execute 120 sec latency 363.019 ms 2024-02-19T22:15:56.104 INFO:tasks.workunit.client.1.smithi138.stdout: 10 113790 24.07 MB/sec execute 124 sec latency 56.078 ms 2024-02-19T22:15:56.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:54.645463+0000 mgr.smithi099.zfglya (mgr.14180) 785 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 422 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 9.1 MiB/s wr, 445 op/s 2024-02-19T22:15:56.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:54.645463+0000 mgr.smithi099.zfglya (mgr.14180) 785 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 422 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 9.1 MiB/s wr, 445 op/s 2024-02-19T22:15:56.782 INFO:tasks.workunit.client.0.smithi099.stdout: 10 214721 47.83 MB/sec execute 121 sec latency 115.544 ms 2024-02-19T22:15:57.104 INFO:tasks.workunit.client.1.smithi138.stdout: 10 114195 24.04 MB/sec execute 125 sec latency 102.304 ms 2024-02-19T22:15:57.782 INFO:tasks.workunit.client.0.smithi099.stdout: 10 216196 48.18 MB/sec execute 122 sec latency 100.572 ms 2024-02-19T22:15:58.104 INFO:tasks.workunit.client.1.smithi138.stdout: 10 114550 23.97 MB/sec execute 126 sec latency 75.939 ms 2024-02-19T22:15:58.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:56.646047+0000 mgr.smithi099.zfglya (mgr.14180) 786 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 418 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 469 op/s 2024-02-19T22:15:58.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:56.646047+0000 mgr.smithi099.zfglya (mgr.14180) 786 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 418 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 469 op/s 2024-02-19T22:15:58.782 INFO:tasks.workunit.client.0.smithi099.stdout: 10 217166 48.20 MB/sec execute 123 sec latency 152.339 ms 2024-02-19T22:15:59.105 INFO:tasks.workunit.client.1.smithi138.stdout: 10 114880 23.87 MB/sec execute 127 sec latency 119.184 ms 2024-02-19T22:15:59.785 INFO:tasks.workunit.client.0.smithi099.stdout: 10 218030 48.20 MB/sec execute 124 sec latency 97.404 ms 2024-02-19T22:16:00.104 INFO:tasks.workunit.client.1.smithi138.stdout: 10 115212 23.79 MB/sec execute 128 sec latency 116.770 ms 2024-02-19T22:16:00.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:15:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:15:58.646616+0000 mgr.smithi099.zfglya (mgr.14180) 787 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 434 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 17 KiB/s rd, 11 MiB/s wr, 552 op/s 2024-02-19T22:16:00.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:15:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:15:58.646616+0000 mgr.smithi099.zfglya (mgr.14180) 787 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 434 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 17 KiB/s rd, 11 MiB/s wr, 552 op/s 2024-02-19T22:16:00.785 INFO:tasks.workunit.client.0.smithi099.stdout: 10 219414 48.41 MB/sec execute 125 sec latency 101.198 ms 2024-02-19T22:16:01.104 INFO:tasks.workunit.client.1.smithi138.stdout: 10 115634 23.76 MB/sec execute 129 sec latency 98.136 ms 2024-02-19T22:16:01.785 INFO:tasks.workunit.client.0.smithi099.stdout: 10 220699 48.57 MB/sec execute 126 sec latency 104.205 ms 2024-02-19T22:16:01.828 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:00.647093+0000 mgr.smithi099.zfglya (mgr.14180) 788 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 434 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 489 op/s 2024-02-19T22:16:02.105 INFO:tasks.workunit.client.1.smithi138.stdout: 10 116062 23.74 MB/sec execute 130 sec latency 105.417 ms 2024-02-19T22:16:02.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:00.647093+0000 mgr.smithi099.zfglya (mgr.14180) 788 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 434 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 489 op/s 2024-02-19T22:16:02.785 INFO:tasks.workunit.client.0.smithi099.stdout: 10 220777 48.20 MB/sec execute 127 sec latency 144.408 ms 2024-02-19T22:16:03.104 INFO:tasks.workunit.client.1.smithi138.stdout: 10 116609 23.85 MB/sec execute 131 sec latency 36.075 ms 2024-02-19T22:16:03.785 INFO:tasks.workunit.client.0.smithi099.stdout: 10 222176 48.29 MB/sec execute 128 sec latency 119.466 ms 2024-02-19T22:16:04.105 INFO:tasks.workunit.client.1.smithi138.stdout: 10 117134 23.98 MB/sec execute 132 sec latency 80.910 ms 2024-02-19T22:16:04.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:02.647548+0000 mgr.smithi099.zfglya (mgr.14180) 789 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 424 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 9.4 MiB/s wr, 505 op/s 2024-02-19T22:16:04.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:02.647548+0000 mgr.smithi099.zfglya (mgr.14180) 789 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 424 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 9.4 MiB/s wr, 505 op/s 2024-02-19T22:16:04.785 INFO:tasks.workunit.client.0.smithi099.stdout: 10 223298 48.53 MB/sec execute 129 sec latency 107.295 ms 2024-02-19T22:16:05.106 INFO:tasks.workunit.client.1.smithi138.stdout: 10 117511 23.95 MB/sec execute 133 sec latency 86.925 ms 2024-02-19T22:16:05.785 INFO:tasks.workunit.client.0.smithi099.stdout: 10 224237 48.54 MB/sec execute 130 sec latency 347.069 ms 2024-02-19T22:16:06.105 INFO:tasks.workunit.client.1.smithi138.stdout: 10 117876 23.89 MB/sec execute 134 sec latency 89.308 ms 2024-02-19T22:16:06.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:04.648048+0000 mgr.smithi099.zfglya (mgr.14180) 790 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 418 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 8.8 MiB/s wr, 467 op/s 2024-02-19T22:16:06.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:04.648048+0000 mgr.smithi099.zfglya (mgr.14180) 790 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 418 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 8.8 MiB/s wr, 467 op/s 2024-02-19T22:16:06.785 INFO:tasks.workunit.client.0.smithi099.stdout: 10 224250 48.17 MB/sec execute 131 sec latency 513.866 ms 2024-02-19T22:16:07.105 INFO:tasks.workunit.client.1.smithi138.stdout: 10 118229 23.80 MB/sec execute 135 sec latency 120.216 ms 2024-02-19T22:16:07.785 INFO:tasks.workunit.client.0.smithi099.stdout: 10 224254 47.81 MB/sec execute 132 sec latency 623.496 ms 2024-02-19T22:16:08.105 INFO:tasks.workunit.client.1.smithi138.stdout: 10 118632 23.76 MB/sec execute 136 sec latency 92.043 ms 2024-02-19T22:16:08.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:06.648586+0000 mgr.smithi099.zfglya (mgr.14180) 791 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 428 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 455 op/s 2024-02-19T22:16:08.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:06.648586+0000 mgr.smithi099.zfglya (mgr.14180) 791 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 428 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 455 op/s 2024-02-19T22:16:08.787 INFO:tasks.workunit.client.0.smithi099.stdout: 10 224297 47.46 MB/sec execute 133 sec latency 544.200 ms 2024-02-19T22:16:09.106 INFO:tasks.workunit.client.1.smithi138.stdout: 10 119035 23.71 MB/sec execute 137 sec latency 150.964 ms 2024-02-19T22:16:09.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 225152 47.46 MB/sec execute 134 sec latency 243.463 ms 2024-02-19T22:16:10.105 INFO:tasks.workunit.client.1.smithi138.stdout: 10 119461 23.69 MB/sec execute 138 sec latency 107.129 ms 2024-02-19T22:16:10.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:08.649044+0000 mgr.smithi099.zfglya (mgr.14180) 792 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 429 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 11 MiB/s wr, 533 op/s 2024-02-19T22:16:10.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:08.649044+0000 mgr.smithi099.zfglya (mgr.14180) 792 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 429 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 11 MiB/s wr, 533 op/s 2024-02-19T22:16:10.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 226505 47.65 MB/sec execute 135 sec latency 109.076 ms 2024-02-19T22:16:11.106 INFO:tasks.workunit.client.1.smithi138.stdout: 10 120008 23.78 MB/sec execute 139 sec latency 74.232 ms 2024-02-19T22:16:11.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 227774 47.80 MB/sec execute 136 sec latency 125.716 ms 2024-02-19T22:16:12.111 INFO:tasks.workunit.client.1.smithi138.stdout: 10 120483 23.90 MB/sec execute 140 sec latency 59.810 ms 2024-02-19T22:16:12.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:10.649518+0000 mgr.smithi099.zfglya (mgr.14180) 793 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 423 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 10 MiB/s wr, 495 op/s 2024-02-19T22:16:12.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:10.649518+0000 mgr.smithi099.zfglya (mgr.14180) 793 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 423 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 10 MiB/s wr, 495 op/s 2024-02-19T22:16:12.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 227941 47.49 MB/sec execute 137 sec latency 110.377 ms 2024-02-19T22:16:13.111 INFO:tasks.workunit.client.1.smithi138.stdout: 10 120880 23.88 MB/sec execute 141 sec latency 83.576 ms 2024-02-19T22:16:13.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 229320 47.57 MB/sec execute 138 sec latency 109.791 ms 2024-02-19T22:16:14.112 INFO:tasks.workunit.client.1.smithi138.stdout: 10 121233 23.83 MB/sec execute 142 sec latency 84.539 ms 2024-02-19T22:16:14.202 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:12.651668+0000 mgr.smithi099.zfglya (mgr.14180) 794 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 427 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 9.9 MiB/s wr, 487 op/s 2024-02-19T22:16:14.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:12.651668+0000 mgr.smithi099.zfglya (mgr.14180) 794 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 427 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 9.9 MiB/s wr, 487 op/s 2024-02-19T22:16:14.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 230380 47.79 MB/sec execute 139 sec latency 127.446 ms 2024-02-19T22:16:15.112 INFO:tasks.workunit.client.1.smithi138.stdout: 10 121612 23.76 MB/sec execute 143 sec latency 87.456 ms 2024-02-19T22:16:15.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 231346 47.81 MB/sec execute 140 sec latency 101.712 ms 2024-02-19T22:16:16.112 INFO:tasks.workunit.client.1.smithi138.stdout: 10 122014 23.71 MB/sec execute 144 sec latency 116.826 ms 2024-02-19T22:16:16.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:14.652135+0000 mgr.smithi099.zfglya (mgr.14180) 795 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 426 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 10 MiB/s wr, 497 op/s 2024-02-19T22:16:16.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:14.652135+0000 mgr.smithi099.zfglya (mgr.14180) 795 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 426 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 10 MiB/s wr, 497 op/s 2024-02-19T22:16:16.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 231943 47.72 MB/sec execute 141 sec latency 85.618 ms 2024-02-19T22:16:17.112 INFO:tasks.workunit.client.1.smithi138.stdout: 10 122357 23.64 MB/sec execute 145 sec latency 131.862 ms 2024-02-19T22:16:17.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:16:16.508238+0000 mon.smithi099 (mon.0) 814 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:16:17.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:16:16.508238+0000 mon.smithi099 (mon.0) 814 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:16:17.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 233359 47.87 MB/sec execute 142 sec latency 138.725 ms 2024-02-19T22:16:18.112 INFO:tasks.workunit.client.1.smithi138.stdout: 10 122841 23.65 MB/sec execute 146 sec latency 134.816 ms 2024-02-19T22:16:18.202 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:16.652727+0000 mgr.smithi099.zfglya (mgr.14180) 796 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 435 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 539 op/s 2024-02-19T22:16:18.202 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:16:16.989793+0000 mon.smithi099 (mon.0) 815 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:16:18.202 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:16:16.990655+0000 mon.smithi099 (mon.0) 816 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:16:18.202 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:16:16.996291+0000 mon.smithi099 (mon.0) 817 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:16:18.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:16.652727+0000 mgr.smithi099.zfglya (mgr.14180) 796 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 435 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 539 op/s 2024-02-19T22:16:18.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:16:16.989793+0000 mon.smithi099 (mon.0) 815 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:16:18.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:16:16.990655+0000 mon.smithi099 (mon.0) 816 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:16:18.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:16:16.996291+0000 mon.smithi099 (mon.0) 817 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:16:18.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 234829 48.13 MB/sec execute 143 sec latency 133.429 ms 2024-02-19T22:16:19.112 INFO:tasks.workunit.client.1.smithi138.stdout: 10 123416 23.73 MB/sec execute 147 sec latency 72.200 ms 2024-02-19T22:16:19.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 234931 47.82 MB/sec execute 144 sec latency 330.667 ms 2024-02-19T22:16:20.115 INFO:tasks.workunit.client.1.smithi138.stdout: 10 123945 23.83 MB/sec execute 148 sec latency 67.886 ms 2024-02-19T22:16:20.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:18.653690+0000 mgr.smithi099.zfglya (mgr.14180) 797 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 423 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 11 MiB/s wr, 565 op/s 2024-02-19T22:16:20.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:18.653690+0000 mgr.smithi099.zfglya (mgr.14180) 797 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 423 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 11 MiB/s wr, 565 op/s 2024-02-19T22:16:20.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 235740 47.81 MB/sec execute 145 sec latency 99.303 ms 2024-02-19T22:16:21.114 INFO:tasks.workunit.client.1.smithi138.stdout: 10 124433 23.88 MB/sec execute 149 sec latency 54.820 ms 2024-02-19T22:16:21.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 237054 47.97 MB/sec execute 146 sec latency 108.142 ms 2024-02-19T22:16:22.113 INFO:tasks.workunit.client.1.smithi138.stdout: 10 124834 23.86 MB/sec execute 150 sec latency 97.191 ms 2024-02-19T22:16:22.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:20.654243+0000 mgr.smithi099.zfglya (mgr.14180) 798 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 422 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 498 op/s 2024-02-19T22:16:22.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:20.654243+0000 mgr.smithi099.zfglya (mgr.14180) 798 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 422 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 498 op/s 2024-02-19T22:16:22.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 238384 48.12 MB/sec execute 147 sec latency 102.301 ms 2024-02-19T22:16:23.113 INFO:tasks.workunit.client.1.smithi138.stdout: 10 125157 23.76 MB/sec execute 151 sec latency 102.309 ms 2024-02-19T22:16:23.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 238593 47.83 MB/sec execute 148 sec latency 87.659 ms 2024-02-19T22:16:24.113 INFO:tasks.workunit.client.1.smithi138.stdout: 10 125478 23.71 MB/sec execute 152 sec latency 128.065 ms 2024-02-19T22:16:24.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:22.654822+0000 mgr.smithi099.zfglya (mgr.14180) 799 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 417 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 444 op/s 2024-02-19T22:16:24.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:22.654822+0000 mgr.smithi099.zfglya (mgr.14180) 799 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 417 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 444 op/s 2024-02-19T22:16:24.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 240063 47.93 MB/sec execute 149 sec latency 102.616 ms 2024-02-19T22:16:25.113 INFO:tasks.workunit.client.1.smithi138.stdout: 10 125946 23.65 MB/sec execute 153 sec latency 88.169 ms 2024-02-19T22:16:25.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 241141 48.17 MB/sec execute 150 sec latency 127.010 ms 2024-02-19T22:16:26.114 INFO:tasks.workunit.client.1.smithi138.stdout: 10 126423 23.66 MB/sec execute 154 sec latency 97.815 ms 2024-02-19T22:16:26.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:24.655331+0000 mgr.smithi099.zfglya (mgr.14180) 800 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 427 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 11 MiB/s wr, 507 op/s 2024-02-19T22:16:26.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:24.655331+0000 mgr.smithi099.zfglya (mgr.14180) 800 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 427 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 11 MiB/s wr, 507 op/s 2024-02-19T22:16:26.788 INFO:tasks.workunit.client.0.smithi099.stdout: 10 242022 48.13 MB/sec execute 151 sec latency 99.331 ms 2024-02-19T22:16:27.114 INFO:tasks.workunit.client.1.smithi138.stdout: 10 127007 23.77 MB/sec execute 155 sec latency 84.511 ms 2024-02-19T22:16:27.789 INFO:tasks.workunit.client.0.smithi099.stdout: 10 242832 48.12 MB/sec execute 152 sec latency 116.847 ms 2024-02-19T22:16:28.114 INFO:tasks.workunit.client.1.smithi138.stdout: 10 127523 23.85 MB/sec execute 156 sec latency 83.966 ms 2024-02-19T22:16:28.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:26.655826+0000 mgr.smithi099.zfglya (mgr.14180) 801 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 419 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 491 op/s 2024-02-19T22:16:28.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:26.655826+0000 mgr.smithi099.zfglya (mgr.14180) 801 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 419 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 491 op/s 2024-02-19T22:16:28.789 INFO:tasks.workunit.client.0.smithi099.stdout: 10 244145 48.27 MB/sec execute 153 sec latency 136.820 ms 2024-02-19T22:16:29.114 INFO:tasks.workunit.client.1.smithi138.stdout: 10 127985 23.88 MB/sec execute 157 sec latency 57.272 ms 2024-02-19T22:16:29.789 INFO:tasks.workunit.client.0.smithi099.stdout: 10 245471 48.42 MB/sec execute 154 sec latency 109.638 ms 2024-02-19T22:16:30.114 INFO:tasks.workunit.client.1.smithi138.stdout: 10 128329 23.85 MB/sec execute 158 sec latency 89.278 ms 2024-02-19T22:16:30.200 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:28.656300+0000 mgr.smithi099.zfglya (mgr.14180) 802 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 408 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 9.8 MiB/s wr, 450 op/s 2024-02-19T22:16:30.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:28.656300+0000 mgr.smithi099.zfglya (mgr.14180) 802 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 408 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 9.8 MiB/s wr, 450 op/s 2024-02-19T22:16:30.789 INFO:tasks.workunit.client.0.smithi099.stdout: 10 245528 48.12 MB/sec execute 155 sec latency 372.232 ms 2024-02-19T22:16:31.114 INFO:tasks.workunit.client.1.smithi138.stdout: 10 128648 23.76 MB/sec execute 159 sec latency 131.924 ms 2024-02-19T22:16:31.789 INFO:tasks.workunit.client.0.smithi099.stdout: 10 245757 47.84 MB/sec execute 156 sec latency 116.202 ms 2024-02-19T22:16:32.114 INFO:tasks.workunit.client.1.smithi138.stdout: 10 129010 23.72 MB/sec execute 160 sec latency 96.755 ms 2024-02-19T22:16:32.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:30.656964+0000 mgr.smithi099.zfglya (mgr.14180) 803 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 425 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 531 op/s 2024-02-19T22:16:32.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:30.656964+0000 mgr.smithi099.zfglya (mgr.14180) 803 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 425 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 531 op/s 2024-02-19T22:16:32.789 INFO:tasks.workunit.client.0.smithi099.stdout: 10 247339 48.03 MB/sec execute 157 sec latency 119.806 ms 2024-02-19T22:16:33.114 INFO:tasks.workunit.client.1.smithi138.stdout: 10 129396 23.65 MB/sec execute 161 sec latency 90.048 ms 2024-02-19T22:16:33.789 INFO:tasks.workunit.client.0.smithi099.stdout: 10 249010 48.40 MB/sec execute 158 sec latency 117.463 ms 2024-02-19T22:16:34.114 INFO:tasks.workunit.client.1.smithi138.stdout: 10 129887 23.66 MB/sec execute 162 sec latency 93.963 ms 2024-02-19T22:16:34.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:32.657519+0000 mgr.smithi099.zfglya (mgr.14180) 804 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 429 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 574 op/s 2024-02-19T22:16:34.454 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:32.657519+0000 mgr.smithi099.zfglya (mgr.14180) 804 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 429 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 574 op/s 2024-02-19T22:16:34.789 INFO:tasks.workunit.client.0.smithi099.stdout: 10 249136 48.12 MB/sec execute 159 sec latency 100.219 ms 2024-02-19T22:16:35.114 INFO:tasks.workunit.client.1.smithi138.stdout: 10 130417 23.72 MB/sec execute 163 sec latency 103.368 ms 2024-02-19T22:16:35.789 INFO:tasks.workunit.client.0.smithi099.stdout: 10 250144 48.12 MB/sec execute 160 sec latency 141.733 ms 2024-02-19T22:16:36.115 INFO:tasks.workunit.client.1.smithi138.stdout: 10 130947 23.78 MB/sec execute 164 sec latency 68.759 ms 2024-02-19T22:16:36.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:34.658010+0000 mgr.smithi099.zfglya (mgr.14180) 805 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 422 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 10 MiB/s wr, 561 op/s 2024-02-19T22:16:36.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:34.658010+0000 mgr.smithi099.zfglya (mgr.14180) 805 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 422 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 10 MiB/s wr, 561 op/s 2024-02-19T22:16:36.789 INFO:tasks.workunit.client.0.smithi099.stdout: 10 251381 48.28 MB/sec execute 161 sec latency 113.377 ms 2024-02-19T22:16:37.115 INFO:tasks.workunit.client.1.smithi138.stdout: 10 131484 23.87 MB/sec execute 165 sec latency 55.240 ms 2024-02-19T22:16:37.790 INFO:tasks.workunit.client.0.smithi099.stdout: 10 252614 48.40 MB/sec execute 162 sec latency 92.453 ms 2024-02-19T22:16:38.117 INFO:tasks.workunit.client.1.smithi138.stdout: 10 131861 23.83 MB/sec execute 166 sec latency 76.572 ms 2024-02-19T22:16:38.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:36.658497+0000 mgr.smithi099.zfglya (mgr.14180) 806 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 416 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 15 KiB/s rd, 11 MiB/s wr, 472 op/s 2024-02-19T22:16:38.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:36.658497+0000 mgr.smithi099.zfglya (mgr.14180) 806 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 416 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 15 KiB/s rd, 11 MiB/s wr, 472 op/s 2024-02-19T22:16:38.790 INFO:tasks.workunit.client.0.smithi099.stdout: 10 252796 48.13 MB/sec execute 163 sec latency 108.322 ms 2024-02-19T22:16:39.118 INFO:tasks.workunit.client.1.smithi138.stdout: 10 132185 23.76 MB/sec execute 167 sec latency 93.457 ms 2024-02-19T22:16:39.790 INFO:tasks.workunit.client.0.smithi099.stdout: 10 254262 48.21 MB/sec execute 164 sec latency 109.008 ms 2024-02-19T22:16:40.118 INFO:tasks.workunit.client.1.smithi138.stdout: 10 132553 23.73 MB/sec execute 168 sec latency 129.453 ms 2024-02-19T22:16:40.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:38.659044+0000 mgr.smithi099.zfglya (mgr.14180) 807 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 420 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 11 MiB/s wr, 500 op/s 2024-02-19T22:16:40.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:38.659044+0000 mgr.smithi099.zfglya (mgr.14180) 807 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 420 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 11 MiB/s wr, 500 op/s 2024-02-19T22:16:40.790 INFO:tasks.workunit.client.0.smithi099.stdout: 10 255185 48.37 MB/sec execute 165 sec latency 212.607 ms 2024-02-19T22:16:41.118 INFO:tasks.workunit.client.1.smithi138.stdout: 10 132979 23.67 MB/sec execute 169 sec latency 96.086 ms 2024-02-19T22:16:41.790 INFO:tasks.workunit.client.0.smithi099.stdout: 10 255476 48.17 MB/sec execute 166 sec latency 559.379 ms 2024-02-19T22:16:42.118 INFO:tasks.workunit.client.1.smithi138.stdout: 10 133477 23.68 MB/sec execute 170 sec latency 106.913 ms 2024-02-19T22:16:42.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:40.659613+0000 mgr.smithi099.zfglya (mgr.14180) 808 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 424 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 553 op/s 2024-02-19T22:16:42.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:41 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:40.659613+0000 mgr.smithi099.zfglya (mgr.14180) 808 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 424 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 553 op/s 2024-02-19T22:16:42.791 INFO:tasks.workunit.client.0.smithi099.stdout: 10 256100 48.08 MB/sec execute 167 sec latency 469.205 ms 2024-02-19T22:16:43.118 INFO:tasks.workunit.client.1.smithi138.stdout: 10 134012 23.73 MB/sec execute 171 sec latency 89.214 ms 2024-02-19T22:16:43.791 INFO:tasks.workunit.client.0.smithi099.stdout: 10 256105 47.80 MB/sec execute 168 sec latency 484.411 ms 2024-02-19T22:16:44.118 INFO:tasks.workunit.client.1.smithi138.stdout: 10 134528 23.80 MB/sec execute 172 sec latency 68.091 ms 2024-02-19T22:16:44.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:42.660152+0000 mgr.smithi099.zfglya (mgr.14180) 809 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 420 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 481 op/s 2024-02-19T22:16:44.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:43 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:42.660152+0000 mgr.smithi099.zfglya (mgr.14180) 809 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 420 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 481 op/s 2024-02-19T22:16:44.791 INFO:tasks.workunit.client.0.smithi099.stdout: 10 256139 47.52 MB/sec execute 169 sec latency 491.368 ms 2024-02-19T22:16:45.118 INFO:tasks.workunit.client.1.smithi138.stdout: 10 134999 23.87 MB/sec execute 173 sec latency 64.973 ms 2024-02-19T22:16:45.791 INFO:tasks.workunit.client.0.smithi099.stdout: 10 256204 47.25 MB/sec execute 170 sec latency 418.784 ms 2024-02-19T22:16:46.118 INFO:tasks.workunit.client.1.smithi138.stdout: 10 135351 23.82 MB/sec execute 174 sec latency 94.289 ms 2024-02-19T22:16:46.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:44.660555+0000 mgr.smithi099.zfglya (mgr.14180) 810 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 417 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 22 KiB/s rd, 9.4 MiB/s wr, 493 op/s 2024-02-19T22:16:46.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:45 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:44.660555+0000 mgr.smithi099.zfglya (mgr.14180) 810 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 417 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 22 KiB/s rd, 9.4 MiB/s wr, 493 op/s 2024-02-19T22:16:46.791 INFO:tasks.workunit.client.0.smithi099.stdout: 10 257029 47.25 MB/sec execute 171 sec latency 107.311 ms 2024-02-19T22:16:47.118 INFO:tasks.workunit.client.1.smithi138.stdout: 10 135676 23.76 MB/sec execute 175 sec latency 94.210 ms 2024-02-19T22:16:47.791 INFO:tasks.workunit.client.0.smithi099.stdout: 10 258328 47.39 MB/sec execute 172 sec latency 129.603 ms 2024-02-19T22:16:48.119 INFO:tasks.workunit.client.1.smithi138.stdout: 10 136049 23.73 MB/sec execute 176 sec latency 99.336 ms 2024-02-19T22:16:48.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:46.661121+0000 mgr.smithi099.zfglya (mgr.14180) 811 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 419 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 511 op/s 2024-02-19T22:16:48.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:47 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:46.661121+0000 mgr.smithi099.zfglya (mgr.14180) 811 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 419 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 511 op/s 2024-02-19T22:16:48.791 INFO:tasks.workunit.client.0.smithi099.stdout: 10 259655 47.52 MB/sec execute 173 sec latency 100.600 ms 2024-02-19T22:16:49.119 INFO:tasks.workunit.client.1.smithi138.stdout: 10 136403 23.66 MB/sec execute 177 sec latency 116.741 ms 2024-02-19T22:16:49.791 INFO:tasks.workunit.client.0.smithi099.stdout: 10 259781 47.27 MB/sec execute 174 sec latency 105.841 ms 2024-02-19T22:16:50.119 INFO:tasks.workunit.client.1.smithi138.stdout: 10 136825 23.64 MB/sec execute 178 sec latency 175.923 ms 2024-02-19T22:16:50.295 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:48.661694+0000 mgr.smithi099.zfglya (mgr.14180) 812 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 428 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 12 MiB/s wr, 583 op/s 2024-02-19T22:16:50.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:49 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:48.661694+0000 mgr.smithi099.zfglya (mgr.14180) 812 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 428 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 12 MiB/s wr, 583 op/s 2024-02-19T22:16:50.791 INFO:tasks.workunit.client.0.smithi099.stdout: 10 260809 47.27 MB/sec execute 175 sec latency 121.076 ms 2024-02-19T22:16:51.119 INFO:tasks.workunit.client.1.smithi138.stdout: 10 137308 23.66 MB/sec execute 179 sec latency 100.939 ms 2024-02-19T22:16:51.792 INFO:tasks.workunit.client.0.smithi099.stdout: 10 261876 47.40 MB/sec execute 176 sec latency 330.946 ms 2024-02-19T22:16:52.119 INFO:tasks.workunit.client.1.smithi138.stdout: 10 137883 23.73 MB/sec execute 180 sec latency 71.941 ms 2024-02-19T22:16:52.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:50.662196+0000 mgr.smithi099.zfglya (mgr.14180) 813 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 416 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 15 KiB/s rd, 12 MiB/s wr, 556 op/s 2024-02-19T22:16:52.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:50.662196+0000 mgr.smithi099.zfglya (mgr.14180) 813 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 416 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 15 KiB/s rd, 12 MiB/s wr, 556 op/s 2024-02-19T22:16:52.791 INFO:tasks.workunit.client.0.smithi099.stdout: 10 263196 47.53 MB/sec execute 177 sec latency 130.621 ms 2024-02-19T22:16:53.119 INFO:tasks.workunit.client.1.smithi138.stdout: 10 138371 23.82 MB/sec execute 181 sec latency 77.945 ms 2024-02-19T22:16:53.792 INFO:tasks.workunit.client.0.smithi099.stdout: 10 263322 47.28 MB/sec execute 178 sec latency 96.567 ms 2024-02-19T22:16:54.119 INFO:tasks.workunit.client.1.smithi138.stdout: 10 138669 23.76 MB/sec execute 182 sec latency 138.559 ms 2024-02-19T22:16:54.295 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:52.662777+0000 mgr.smithi099.zfglya (mgr.14180) 814 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 410 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 15 KiB/s rd, 10 MiB/s wr, 537 op/s 2024-02-19T22:16:54.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:52.662777+0000 mgr.smithi099.zfglya (mgr.14180) 814 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 410 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 15 KiB/s rd, 10 MiB/s wr, 537 op/s 2024-02-19T22:16:54.792 INFO:tasks.workunit.client.0.smithi099.stdout: 10 264404 47.29 MB/sec execute 179 sec latency 123.655 ms 2024-02-19T22:16:55.119 INFO:tasks.workunit.client.1.smithi138.stdout: 10 139043 23.73 MB/sec execute 183 sec latency 42.948 ms 2024-02-19T22:16:55.792 INFO:tasks.workunit.client.0.smithi099.stdout: 10 265646 47.45 MB/sec execute 180 sec latency 125.564 ms 2024-02-19T22:16:56.119 INFO:tasks.workunit.client.1.smithi138.stdout: 10 139351 23.66 MB/sec execute 184 sec latency 82.403 ms 2024-02-19T22:16:56.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:54.663240+0000 mgr.smithi099.zfglya (mgr.14180) 815 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 409 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 9.7 MiB/s wr, 482 op/s 2024-02-19T22:16:56.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:54.663240+0000 mgr.smithi099.zfglya (mgr.14180) 815 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 409 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 9.7 MiB/s wr, 482 op/s 2024-02-19T22:16:56.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 266784 47.54 MB/sec execute 181 sec latency 101.570 ms 2024-02-19T22:16:57.120 INFO:tasks.workunit.client.1.smithi138.stdout: 10 139714 23.64 MB/sec execute 185 sec latency 107.615 ms 2024-02-19T22:16:57.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 266957 47.30 MB/sec execute 182 sec latency 117.307 ms 2024-02-19T22:16:58.123 INFO:tasks.workunit.client.1.smithi138.stdout: 10 140132 23.58 MB/sec execute 186 sec latency 104.528 ms 2024-02-19T22:16:58.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:16:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:56.663733+0000 mgr.smithi099.zfglya (mgr.14180) 816 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 428 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 511 op/s 2024-02-19T22:16:58.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:16:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:56.663733+0000 mgr.smithi099.zfglya (mgr.14180) 816 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 428 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 511 op/s 2024-02-19T22:16:58.792 INFO:tasks.workunit.client.0.smithi099.stdout: 10 268271 47.36 MB/sec execute 183 sec latency 119.348 ms 2024-02-19T22:16:59.123 INFO:tasks.workunit.client.1.smithi138.stdout: 10 140572 23.58 MB/sec execute 187 sec latency 102.207 ms 2024-02-19T22:16:59.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 269367 47.53 MB/sec execute 184 sec latency 129.563 ms 2024-02-19T22:17:00.123 INFO:tasks.workunit.client.1.smithi138.stdout: 10 141095 23.62 MB/sec execute 188 sec latency 60.325 ms 2024-02-19T22:17:00.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:16:58.664305+0000 mgr.smithi099.zfglya (mgr.14180) 817 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 426 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 11 MiB/s wr, 533 op/s 2024-02-19T22:17:00.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:16:58.664305+0000 mgr.smithi099.zfglya (mgr.14180) 817 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 426 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 11 MiB/s wr, 533 op/s 2024-02-19T22:17:00.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 270341 47.55 MB/sec execute 185 sec latency 133.661 ms 2024-02-19T22:17:01.123 INFO:tasks.workunit.client.1.smithi138.stdout: 10 141581 23.68 MB/sec execute 189 sec latency 75.485 ms 2024-02-19T22:17:01.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 270519 47.32 MB/sec execute 186 sec latency 106.894 ms 2024-02-19T22:17:02.123 INFO:tasks.workunit.client.1.smithi138.stdout: 10 142019 23.73 MB/sec execute 190 sec latency 91.790 ms 2024-02-19T22:17:02.295 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:00.664879+0000 mgr.smithi099.zfglya (mgr.14180) 818 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 412 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 459 op/s 2024-02-19T22:17:02.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:00.664879+0000 mgr.smithi099.zfglya (mgr.14180) 818 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 412 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 459 op/s 2024-02-19T22:17:02.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 271867 47.38 MB/sec execute 187 sec latency 122.626 ms 2024-02-19T22:17:03.123 INFO:tasks.workunit.client.1.smithi138.stdout: 10 142431 23.70 MB/sec execute 191 sec latency 43.622 ms 2024-02-19T22:17:03.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 272910 47.54 MB/sec execute 188 sec latency 129.136 ms 2024-02-19T22:17:04.123 INFO:tasks.workunit.client.1.smithi138.stdout: 10 142769 23.65 MB/sec execute 192 sec latency 145.603 ms 2024-02-19T22:17:04.295 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:02.665396+0000 mgr.smithi099.zfglya (mgr.14180) 819 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 408 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 531 op/s 2024-02-19T22:17:04.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:02.665396+0000 mgr.smithi099.zfglya (mgr.14180) 819 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 408 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 531 op/s 2024-02-19T22:17:04.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 273891 47.55 MB/sec execute 189 sec latency 100.475 ms 2024-02-19T22:17:05.123 INFO:tasks.workunit.client.1.smithi138.stdout: 10 143130 23.62 MB/sec execute 193 sec latency 103.678 ms 2024-02-19T22:17:05.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 274129 47.33 MB/sec execute 190 sec latency 101.267 ms 2024-02-19T22:17:06.123 INFO:tasks.workunit.client.1.smithi138.stdout: 10 143419 23.55 MB/sec execute 194 sec latency 153.699 ms 2024-02-19T22:17:06.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:04.665955+0000 mgr.smithi099.zfglya (mgr.14180) 820 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 413 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 18 KiB/s rd, 9.7 MiB/s wr, 476 op/s 2024-02-19T22:17:06.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:04.665955+0000 mgr.smithi099.zfglya (mgr.14180) 820 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 413 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 18 KiB/s rd, 9.7 MiB/s wr, 476 op/s 2024-02-19T22:17:06.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 275557 47.41 MB/sec execute 191 sec latency 131.133 ms 2024-02-19T22:17:07.123 INFO:tasks.workunit.client.1.smithi138.stdout: 10 143946 23.55 MB/sec execute 195 sec latency 51.690 ms 2024-02-19T22:17:07.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 276286 47.47 MB/sec execute 192 sec latency 374.796 ms 2024-02-19T22:17:08.123 INFO:tasks.workunit.client.1.smithi138.stdout: 10 144430 23.57 MB/sec execute 196 sec latency 84.705 ms 2024-02-19T22:17:08.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:06.666424+0000 mgr.smithi099.zfglya (mgr.14180) 821 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 413 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 496 op/s 2024-02-19T22:17:08.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:06.666424+0000 mgr.smithi099.zfglya (mgr.14180) 821 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 413 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 496 op/s 2024-02-19T22:17:08.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 277427 47.56 MB/sec execute 193 sec latency 101.376 ms 2024-02-19T22:17:09.123 INFO:tasks.workunit.client.1.smithi138.stdout: 10 145009 23.63 MB/sec execute 197 sec latency 74.790 ms 2024-02-19T22:17:09.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 277590 47.33 MB/sec execute 194 sec latency 92.055 ms 2024-02-19T22:17:10.123 INFO:tasks.workunit.client.1.smithi138.stdout: 10 145562 23.74 MB/sec execute 198 sec latency 101.684 ms 2024-02-19T22:17:10.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:08.666911+0000 mgr.smithi099.zfglya (mgr.14180) 822 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 414 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 9.7 MiB/s wr, 503 op/s 2024-02-19T22:17:10.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:08.666911+0000 mgr.smithi099.zfglya (mgr.14180) 822 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 414 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 9.7 MiB/s wr, 503 op/s 2024-02-19T22:17:10.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 278904 47.38 MB/sec execute 195 sec latency 123.768 ms 2024-02-19T22:17:11.126 INFO:tasks.workunit.client.1.smithi138.stdout: 10 145944 23.69 MB/sec execute 199 sec latency 91.361 ms 2024-02-19T22:17:11.793 INFO:tasks.workunit.client.0.smithi099.stdout: 10 280001 47.55 MB/sec execute 196 sec latency 118.931 ms 2024-02-19T22:17:12.126 INFO:tasks.workunit.client.1.smithi138.stdout: 10 146274 23.65 MB/sec execute 200 sec latency 90.912 ms 2024-02-19T22:17:12.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:10.667436+0000 mgr.smithi099.zfglya (mgr.14180) 823 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 407 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 497 op/s 2024-02-19T22:17:12.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:10.667436+0000 mgr.smithi099.zfglya (mgr.14180) 823 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 407 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 497 op/s 2024-02-19T22:17:12.794 INFO:tasks.workunit.client.0.smithi099.stdout: 10 280976 47.56 MB/sec execute 197 sec latency 274.678 ms 2024-02-19T22:17:13.128 INFO:tasks.workunit.client.1.smithi138.stdout: 10 146627 23.62 MB/sec execute 201 sec latency 141.091 ms 2024-02-19T22:17:13.797 INFO:tasks.workunit.client.0.smithi099.stdout: 10 281159 47.34 MB/sec execute 198 sec latency 100.597 ms 2024-02-19T22:17:14.128 INFO:tasks.workunit.client.1.smithi138.stdout: 10 146969 23.57 MB/sec execute 202 sec latency 139.859 ms 2024-02-19T22:17:14.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:12.667902+0000 mgr.smithi099.zfglya (mgr.14180) 824 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 414 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 531 op/s 2024-02-19T22:17:14.452 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:12.667902+0000 mgr.smithi099.zfglya (mgr.14180) 824 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 414 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 531 op/s 2024-02-19T22:17:14.797 INFO:tasks.workunit.client.0.smithi099.stdout: 10 282609 47.42 MB/sec execute 199 sec latency 122.966 ms 2024-02-19T22:17:15.128 INFO:tasks.workunit.client.1.smithi138.stdout: 10 147430 23.52 MB/sec execute 203 sec latency 77.179 ms 2024-02-19T22:17:15.797 INFO:tasks.workunit.client.0.smithi099.stdout: 10 283840 47.62 MB/sec execute 200 sec latency 109.520 ms 2024-02-19T22:17:16.128 INFO:tasks.workunit.client.1.smithi138.stdout: 10 147880 23.54 MB/sec execute 204 sec latency 147.176 ms 2024-02-19T22:17:16.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:14.668419+0000 mgr.smithi099.zfglya (mgr.14180) 825 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 418 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 10 MiB/s wr, 482 op/s 2024-02-19T22:17:16.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:14.668419+0000 mgr.smithi099.zfglya (mgr.14180) 825 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 418 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 10 MiB/s wr, 482 op/s 2024-02-19T22:17:16.797 INFO:tasks.workunit.client.0.smithi099.stdout: 10 284587 47.57 MB/sec execute 201 sec latency 98.959 ms 2024-02-19T22:17:17.128 INFO:tasks.workunit.client.1.smithi138.stdout: 10 148468 23.62 MB/sec execute 205 sec latency 80.785 ms 2024-02-19T22:17:17.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:17:17.004351+0000 mon.smithi099 (mon.0) 818 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:17:17.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:17:17.004351+0000 mon.smithi099 (mon.0) 818 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:17:17.797 INFO:tasks.workunit.client.0.smithi099.stdout: 10 285423 47.57 MB/sec execute 202 sec latency 97.367 ms 2024-02-19T22:17:18.128 INFO:tasks.workunit.client.1.smithi138.stdout: 10 148874 23.67 MB/sec execute 206 sec latency 99.176 ms 2024-02-19T22:17:18.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:16.668941+0000 mgr.smithi099.zfglya (mgr.14180) 826 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 406 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 15 KiB/s rd, 11 MiB/s wr, 513 op/s 2024-02-19T22:17:18.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:17:17.461404+0000 mon.smithi099 (mon.0) 819 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:17:18.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:17:17.462196+0000 mon.smithi099 (mon.0) 820 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:17:18.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:17:17.467032+0000 mon.smithi099 (mon.0) 821 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:17:18.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:16.668941+0000 mgr.smithi099.zfglya (mgr.14180) 826 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 406 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 15 KiB/s rd, 11 MiB/s wr, 513 op/s 2024-02-19T22:17:18.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:17:17.461404+0000 mon.smithi099 (mon.0) 819 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:17:18.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:17:17.462196+0000 mon.smithi099 (mon.0) 820 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:17:18.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:17:17.467032+0000 mon.smithi099 (mon.0) 821 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:17:18.799 INFO:tasks.workunit.client.0.smithi099.stdout: 10 285996 47.40 MB/sec execute 203 sec latency 446.690 ms 2024-02-19T22:17:19.128 INFO:tasks.workunit.client.1.smithi138.stdout: 10 149306 23.66 MB/sec execute 207 sec latency 71.901 ms 2024-02-19T22:17:19.798 INFO:tasks.workunit.client.0.smithi099.stdout: 10 286191 47.20 MB/sec execute 204 sec latency 492.920 ms 2024-02-19T22:17:20.128 INFO:tasks.workunit.client.1.smithi138.stdout: 10 149671 23.64 MB/sec execute 208 sec latency 72.016 ms 2024-02-19T22:17:20.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:18.669483+0000 mgr.smithi099.zfglya (mgr.14180) 827 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 409 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 11 MiB/s wr, 604 op/s 2024-02-19T22:17:20.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:18.669483+0000 mgr.smithi099.zfglya (mgr.14180) 827 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 409 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 11 MiB/s wr, 604 op/s 2024-02-19T22:17:20.798 INFO:tasks.workunit.client.0.smithi099.stdout: 10 286464 47.11 MB/sec execute 205 sec latency 514.750 ms 2024-02-19T22:17:21.128 INFO:tasks.workunit.client.1.smithi138.stdout: 10 149975 23.57 MB/sec execute 209 sec latency 106.380 ms 2024-02-19T22:17:21.798 INFO:tasks.workunit.client.0.smithi099.stdout: 10 286746 47.00 MB/sec execute 206 sec latency 446.090 ms 2024-02-19T22:17:22.128 INFO:tasks.workunit.client.1.smithi138.stdout: 10 150337 23.55 MB/sec execute 210 sec latency 111.290 ms 2024-02-19T22:17:22.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:20.669938+0000 mgr.smithi099.zfglya (mgr.14180) 828 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 419 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 501 op/s 2024-02-19T22:17:22.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:20.669938+0000 mgr.smithi099.zfglya (mgr.14180) 828 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 419 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 501 op/s 2024-02-19T22:17:22.798 INFO:tasks.workunit.client.0.smithi099.stdout: 10 287092 46.87 MB/sec execute 207 sec latency 375.377 ms 2024-02-19T22:17:23.129 INFO:tasks.workunit.client.1.smithi138.stdout: 10 150774 23.51 MB/sec execute 211 sec latency 118.683 ms 2024-02-19T22:17:23.800 INFO:tasks.workunit.client.0.smithi099.stdout: 10 288093 46.89 MB/sec execute 208 sec latency 95.508 ms 2024-02-19T22:17:24.129 INFO:tasks.workunit.client.1.smithi138.stdout: 10 151219 23.50 MB/sec execute 212 sec latency 115.186 ms 2024-02-19T22:17:24.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:22.670496+0000 mgr.smithi099.zfglya (mgr.14180) 829 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 417 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 516 op/s 2024-02-19T22:17:24.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:22.670496+0000 mgr.smithi099.zfglya (mgr.14180) 829 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 417 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 516 op/s 2024-02-19T22:17:24.800 INFO:tasks.workunit.client.0.smithi099.stdout: 10 288894 46.89 MB/sec execute 209 sec latency 102.866 ms 2024-02-19T22:17:25.129 INFO:tasks.workunit.client.1.smithi138.stdout: 10 151759 23.56 MB/sec execute 213 sec latency 61.706 ms 2024-02-19T22:17:25.800 INFO:tasks.workunit.client.0.smithi099.stdout: 10 290087 46.94 MB/sec execute 210 sec latency 166.558 ms 2024-02-19T22:17:26.130 INFO:tasks.workunit.client.1.smithi138.stdout: 10 152225 23.58 MB/sec execute 214 sec latency 66.880 ms 2024-02-19T22:17:26.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:24.670986+0000 mgr.smithi099.zfglya (mgr.14180) 830 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 417 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 9.4 MiB/s wr, 471 op/s 2024-02-19T22:17:26.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:24.670986+0000 mgr.smithi099.zfglya (mgr.14180) 830 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 417 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 9.4 MiB/s wr, 471 op/s 2024-02-19T22:17:26.800 INFO:tasks.workunit.client.0.smithi099.stdout: 10 291559 47.12 MB/sec execute 211 sec latency 110.923 ms 2024-02-19T22:17:27.130 INFO:tasks.workunit.client.1.smithi138.stdout: 10 152693 23.64 MB/sec execute 215 sec latency 53.915 ms 2024-02-19T22:17:27.800 INFO:tasks.workunit.client.0.smithi099.stdout: 10 291684 46.91 MB/sec execute 212 sec latency 117.657 ms 2024-02-19T22:17:28.130 INFO:tasks.workunit.client.1.smithi138.stdout: 10 153018 23.61 MB/sec execute 216 sec latency 120.668 ms 2024-02-19T22:17:28.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:26.671560+0000 mgr.smithi099.zfglya (mgr.14180) 831 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 410 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 496 op/s 2024-02-19T22:17:28.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:26.671560+0000 mgr.smithi099.zfglya (mgr.14180) 831 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 410 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 496 op/s 2024-02-19T22:17:28.803 INFO:tasks.workunit.client.0.smithi099.stdout: 10 292715 46.92 MB/sec execute 213 sec latency 113.190 ms 2024-02-19T22:17:29.131 INFO:tasks.workunit.client.1.smithi138.stdout: 10 153266 23.54 MB/sec execute 217 sec latency 156.484 ms 2024-02-19T22:17:29.803 INFO:tasks.workunit.client.0.smithi099.stdout: 10 294009 47.06 MB/sec execute 214 sec latency 113.233 ms 2024-02-19T22:17:30.131 INFO:tasks.workunit.client.1.smithi138.stdout: 10 153598 23.49 MB/sec execute 218 sec latency 80.814 ms 2024-02-19T22:17:30.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:28.672050+0000 mgr.smithi099.zfglya (mgr.14180) 832 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 419 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 11 MiB/s wr, 538 op/s 2024-02-19T22:17:30.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:28.672050+0000 mgr.smithi099.zfglya (mgr.14180) 832 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 419 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 11 MiB/s wr, 538 op/s 2024-02-19T22:17:30.804 INFO:tasks.workunit.client.0.smithi099.stdout: 10 295157 47.13 MB/sec execute 215 sec latency 126.185 ms 2024-02-19T22:17:31.131 INFO:tasks.workunit.client.1.smithi138.stdout: 10 153955 23.47 MB/sec execute 219 sec latency 104.942 ms 2024-02-19T22:17:31.804 INFO:tasks.workunit.client.0.smithi099.stdout: 10 295336 46.94 MB/sec execute 216 sec latency 96.760 ms 2024-02-19T22:17:32.131 INFO:tasks.workunit.client.1.smithi138.stdout: 10 154408 23.43 MB/sec execute 220 sec latency 103.666 ms 2024-02-19T22:17:32.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:30.672631+0000 mgr.smithi099.zfglya (mgr.14180) 833 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 422 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 443 op/s 2024-02-19T22:17:32.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:30.672631+0000 mgr.smithi099.zfglya (mgr.14180) 833 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 422 MiB data, 6.1 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 443 op/s 2024-02-19T22:17:32.804 INFO:tasks.workunit.client.0.smithi099.stdout: 10 296774 47.00 MB/sec execute 217 sec latency 123.827 ms 2024-02-19T22:17:33.131 INFO:tasks.workunit.client.1.smithi138.stdout: 10 154820 23.43 MB/sec execute 221 sec latency 132.964 ms 2024-02-19T22:17:33.804 INFO:tasks.workunit.client.0.smithi099.stdout: 10 297749 47.13 MB/sec execute 218 sec latency 129.861 ms 2024-02-19T22:17:34.131 INFO:tasks.workunit.client.1.smithi138.stdout: 10 155386 23.48 MB/sec execute 222 sec latency 77.749 ms 2024-02-19T22:17:34.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:32.673107+0000 mgr.smithi099.zfglya (mgr.14180) 834 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 416 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 503 op/s 2024-02-19T22:17:34.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:32.673107+0000 mgr.smithi099.zfglya (mgr.14180) 834 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 416 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 503 op/s 2024-02-19T22:17:34.807 INFO:tasks.workunit.client.0.smithi099.stdout: 10 298734 47.15 MB/sec execute 219 sec latency 89.892 ms 2024-02-19T22:17:35.131 INFO:tasks.workunit.client.1.smithi138.stdout: 10 155845 23.52 MB/sec execute 223 sec latency 86.399 ms 2024-02-19T22:17:35.808 INFO:tasks.workunit.client.0.smithi099.stdout: 10 299113 47.02 MB/sec execute 220 sec latency 112.627 ms 2024-02-19T22:17:36.131 INFO:tasks.workunit.client.1.smithi138.stdout: 10 156321 23.57 MB/sec execute 224 sec latency 61.733 ms 2024-02-19T22:17:36.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:34.673564+0000 mgr.smithi099.zfglya (mgr.14180) 835 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 418 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 9.2 MiB/s wr, 495 op/s 2024-02-19T22:17:36.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:34.673564+0000 mgr.smithi099.zfglya (mgr.14180) 835 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 418 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 9.2 MiB/s wr, 495 op/s 2024-02-19T22:17:36.808 INFO:tasks.workunit.client.0.smithi099.stdout: 10 300729 47.19 MB/sec execute 221 sec latency 111.454 ms 2024-02-19T22:17:37.131 INFO:tasks.workunit.client.1.smithi138.stdout: 10 156704 23.54 MB/sec execute 225 sec latency 126.357 ms 2024-02-19T22:17:37.808 INFO:tasks.workunit.client.0.smithi099.stdout: 10 302203 47.36 MB/sec execute 222 sec latency 114.788 ms 2024-02-19T22:17:38.131 INFO:tasks.workunit.client.1.smithi138.stdout: 10 157050 23.49 MB/sec execute 226 sec latency 156.292 ms 2024-02-19T22:17:38.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:36.674991+0000 mgr.smithi099.zfglya (mgr.14180) 836 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 414 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 507 op/s 2024-02-19T22:17:38.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:36.674991+0000 mgr.smithi099.zfglya (mgr.14180) 836 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 414 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 507 op/s 2024-02-19T22:17:38.808 INFO:tasks.workunit.client.0.smithi099.stdout: 10 302266 47.16 MB/sec execute 223 sec latency 358.777 ms 2024-02-19T22:17:39.131 INFO:tasks.workunit.client.1.smithi138.stdout: 10 157406 23.48 MB/sec execute 227 sec latency 129.017 ms 2024-02-19T22:17:39.808 INFO:tasks.workunit.client.0.smithi099.stdout: 10 302514 46.98 MB/sec execute 224 sec latency 101.968 ms 2024-02-19T22:17:40.131 INFO:tasks.workunit.client.1.smithi138.stdout: 10 157823 23.43 MB/sec execute 228 sec latency 101.098 ms 2024-02-19T22:17:40.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:38.675606+0000 mgr.smithi099.zfglya (mgr.14180) 837 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 417 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 18 KiB/s rd, 10 MiB/s wr, 481 op/s 2024-02-19T22:17:40.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:38.675606+0000 mgr.smithi099.zfglya (mgr.14180) 837 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 417 MiB data, 6.0 GiB used, 709 GiB / 715 GiB avail; 18 KiB/s rd, 10 MiB/s wr, 481 op/s 2024-02-19T22:17:40.808 INFO:tasks.workunit.client.0.smithi099.stdout: 10 303981 47.06 MB/sec execute 225 sec latency 130.054 ms 2024-02-19T22:17:41.132 INFO:tasks.workunit.client.1.smithi138.stdout: 10 158283 23.43 MB/sec execute 229 sec latency 93.711 ms 2024-02-19T22:17:41.811 INFO:tasks.workunit.client.0.smithi099.stdout: 10 305514 47.32 MB/sec execute 226 sec latency 128.895 ms 2024-02-19T22:17:42.133 INFO:tasks.workunit.client.1.smithi138.stdout: 10 158846 23.48 MB/sec execute 230 sec latency 103.331 ms 2024-02-19T22:17:42.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:40.676132+0000 mgr.smithi099.zfglya (mgr.14180) 838 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 422 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 520 op/s 2024-02-19T22:17:42.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:40.676132+0000 mgr.smithi099.zfglya (mgr.14180) 838 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 422 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 520 op/s 2024-02-19T22:17:42.809 INFO:tasks.workunit.client.0.smithi099.stdout: 10 305870 47.18 MB/sec execute 227 sec latency 85.631 ms 2024-02-19T22:17:43.133 INFO:tasks.workunit.client.1.smithi138.stdout: 10 159310 23.49 MB/sec execute 231 sec latency 60.945 ms 2024-02-19T22:17:43.809 INFO:tasks.workunit.client.0.smithi099.stdout: 10 306404 47.12 MB/sec execute 228 sec latency 206.850 ms 2024-02-19T22:17:44.133 INFO:tasks.workunit.client.1.smithi138.stdout: 10 159801 23.57 MB/sec execute 232 sec latency 83.782 ms 2024-02-19T22:17:44.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:42.676602+0000 mgr.smithi099.zfglya (mgr.14180) 839 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 413 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 512 op/s 2024-02-19T22:17:44.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:42.676602+0000 mgr.smithi099.zfglya (mgr.14180) 839 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 413 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 512 op/s 2024-02-19T22:17:44.809 INFO:tasks.workunit.client.0.smithi099.stdout: 10 307617 47.12 MB/sec execute 229 sec latency 247.974 ms 2024-02-19T22:17:45.133 INFO:tasks.workunit.client.1.smithi138.stdout: 10 160151 23.53 MB/sec execute 233 sec latency 142.604 ms 2024-02-19T22:17:45.809 INFO:tasks.workunit.client.0.smithi099.stdout: 10 309291 47.38 MB/sec execute 230 sec latency 119.642 ms 2024-02-19T22:17:46.133 INFO:tasks.workunit.client.1.smithi138.stdout: 10 160510 23.48 MB/sec execute 234 sec latency 90.941 ms 2024-02-19T22:17:46.452 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:44.677193+0000 mgr.smithi099.zfglya (mgr.14180) 840 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 413 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 9.5 MiB/s wr, 490 op/s 2024-02-19T22:17:46.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:44.677193+0000 mgr.smithi099.zfglya (mgr.14180) 840 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 413 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 9.5 MiB/s wr, 490 op/s 2024-02-19T22:17:46.810 INFO:tasks.workunit.client.0.smithi099.stdout: 10 309418 47.19 MB/sec execute 231 sec latency 112.643 ms 2024-02-19T22:17:47.133 INFO:tasks.workunit.client.1.smithi138.stdout: 10 160897 23.49 MB/sec execute 235 sec latency 125.455 ms 2024-02-19T22:17:47.810 INFO:tasks.workunit.client.0.smithi099.stdout: 10 310252 47.19 MB/sec execute 232 sec latency 116.131 ms 2024-02-19T22:17:48.133 INFO:tasks.workunit.client.1.smithi138.stdout: 10 161216 23.43 MB/sec execute 236 sec latency 123.677 ms 2024-02-19T22:17:48.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:46.677773+0000 mgr.smithi099.zfglya (mgr.14180) 841 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 419 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 458 op/s 2024-02-19T22:17:48.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:46.677773+0000 mgr.smithi099.zfglya (mgr.14180) 841 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 419 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 458 op/s 2024-02-19T22:17:48.810 INFO:tasks.workunit.client.0.smithi099.stdout: 10 311586 47.30 MB/sec execute 233 sec latency 120.001 ms 2024-02-19T22:17:49.133 INFO:tasks.workunit.client.1.smithi138.stdout: 10 161621 23.38 MB/sec execute 237 sec latency 145.522 ms 2024-02-19T22:17:49.810 INFO:tasks.workunit.client.0.smithi099.stdout: 10 312836 47.39 MB/sec execute 234 sec latency 257.614 ms 2024-02-19T22:17:50.134 INFO:tasks.workunit.client.1.smithi138.stdout: 10 161968 23.38 MB/sec execute 238 sec latency 128.464 ms 2024-02-19T22:17:50.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:48.678391+0000 mgr.smithi099.zfglya (mgr.14180) 842 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 422 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 11 MiB/s wr, 523 op/s 2024-02-19T22:17:50.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:48.678391+0000 mgr.smithi099.zfglya (mgr.14180) 842 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 422 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 11 MiB/s wr, 523 op/s 2024-02-19T22:17:50.812 INFO:tasks.workunit.client.0.smithi099.stdout: 10 312963 47.20 MB/sec execute 235 sec latency 91.682 ms 2024-02-19T22:17:51.134 INFO:tasks.workunit.client.1.smithi138.stdout: 10 162435 23.41 MB/sec execute 239 sec latency 90.446 ms 2024-02-19T22:17:51.812 INFO:tasks.workunit.client.0.smithi099.stdout: 10 313970 47.20 MB/sec execute 236 sec latency 142.804 ms 2024-02-19T22:17:52.134 INFO:tasks.workunit.client.1.smithi138.stdout: 10 162868 23.41 MB/sec execute 240 sec latency 77.701 ms 2024-02-19T22:17:52.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:50.678874+0000 mgr.smithi099.zfglya (mgr.14180) 843 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 415 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 15 KiB/s rd, 11 MiB/s wr, 549 op/s 2024-02-19T22:17:52.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:50.678874+0000 mgr.smithi099.zfglya (mgr.14180) 843 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 415 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 15 KiB/s rd, 11 MiB/s wr, 549 op/s 2024-02-19T22:17:52.812 INFO:tasks.workunit.client.0.smithi099.stdout: 10 315147 47.31 MB/sec execute 237 sec latency 118.709 ms 2024-02-19T22:17:53.134 INFO:tasks.workunit.client.1.smithi138.stdout: 10 163415 23.49 MB/sec execute 241 sec latency 85.161 ms 2024-02-19T22:17:53.812 INFO:tasks.workunit.client.0.smithi099.stdout: 10 316428 47.40 MB/sec execute 238 sec latency 103.757 ms 2024-02-19T22:17:54.134 INFO:tasks.workunit.client.1.smithi138.stdout: 10 163779 23.46 MB/sec execute 242 sec latency 68.656 ms 2024-02-19T22:17:54.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:52.679448+0000 mgr.smithi099.zfglya (mgr.14180) 844 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 410 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 15 KiB/s rd, 10 MiB/s wr, 491 op/s 2024-02-19T22:17:54.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:52.679448+0000 mgr.smithi099.zfglya (mgr.14180) 844 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 410 MiB data, 6.5 GiB used, 709 GiB / 715 GiB avail; 15 KiB/s rd, 10 MiB/s wr, 491 op/s 2024-02-19T22:17:54.812 INFO:tasks.workunit.client.0.smithi099.stdout: 10 316590 47.22 MB/sec execute 239 sec latency 125.751 ms 2024-02-19T22:17:55.134 INFO:tasks.workunit.client.1.smithi138.stdout: 10 164124 23.41 MB/sec execute 243 sec latency 108.951 ms 2024-02-19T22:17:55.812 INFO:tasks.workunit.client.0.smithi099.stdout: 10 316652 47.03 MB/sec execute 240 sec latency 534.867 ms 2024-02-19T22:17:56.134 INFO:tasks.workunit.client.1.smithi138.stdout: 10 164464 23.39 MB/sec execute 244 sec latency 123.764 ms 2024-02-19T22:17:56.452 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:54.679955+0000 mgr.smithi099.zfglya (mgr.14180) 845 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 411 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 9.7 MiB/s wr, 478 op/s 2024-02-19T22:17:56.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:54.679955+0000 mgr.smithi099.zfglya (mgr.14180) 845 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 411 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 9.7 MiB/s wr, 478 op/s 2024-02-19T22:17:56.812 INFO:tasks.workunit.client.0.smithi099.stdout: 10 316696 46.83 MB/sec execute 241 sec latency 672.398 ms 2024-02-19T22:17:57.134 INFO:tasks.workunit.client.1.smithi138.stdout: 10 164865 23.36 MB/sec execute 245 sec latency 127.397 ms 2024-02-19T22:17:57.812 INFO:tasks.workunit.client.0.smithi099.stdout: 10 317139 46.78 MB/sec execute 242 sec latency 838.188 ms 2024-02-19T22:17:58.134 INFO:tasks.workunit.client.1.smithi138.stdout: 10 165274 23.33 MB/sec execute 246 sec latency 117.947 ms 2024-02-19T22:17:58.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:17:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:56.680583+0000 mgr.smithi099.zfglya (mgr.14180) 846 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 421 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 490 op/s 2024-02-19T22:17:58.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:17:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:56.680583+0000 mgr.smithi099.zfglya (mgr.14180) 846 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 421 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 12 MiB/s wr, 490 op/s 2024-02-19T22:17:58.812 INFO:tasks.workunit.client.0.smithi099.stdout: 10 317519 46.63 MB/sec execute 243 sec latency 506.583 ms 2024-02-19T22:17:59.134 INFO:tasks.workunit.client.1.smithi138.stdout: 10 165674 23.33 MB/sec execute 247 sec latency 89.317 ms 2024-02-19T22:17:59.812 INFO:tasks.workunit.client.0.smithi099.stdout: 10 318110 46.51 MB/sec execute 244 sec latency 442.206 ms 2024-02-19T22:18:00.134 INFO:tasks.workunit.client.1.smithi138.stdout: 10 166229 23.38 MB/sec execute 248 sec latency 78.168 ms 2024-02-19T22:18:00.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:17:58.681070+0000 mgr.smithi099.zfglya (mgr.14180) 847 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 415 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 10 MiB/s wr, 517 op/s 2024-02-19T22:18:00.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:17:58.681070+0000 mgr.smithi099.zfglya (mgr.14180) 847 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 415 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 10 MiB/s wr, 517 op/s 2024-02-19T22:18:00.812 INFO:tasks.workunit.client.0.smithi099.stdout: 10 319036 46.62 MB/sec execute 245 sec latency 124.497 ms 2024-02-19T22:18:01.135 INFO:tasks.workunit.client.1.smithi138.stdout: 10 166640 23.43 MB/sec execute 249 sec latency 92.195 ms 2024-02-19T22:18:01.812 INFO:tasks.workunit.client.0.smithi099.stdout: 10 319990 46.64 MB/sec execute 246 sec latency 97.823 ms 2024-02-19T22:18:02.135 INFO:tasks.workunit.client.1.smithi138.stdout: 10 167058 23.43 MB/sec execute 250 sec latency 108.482 ms 2024-02-19T22:18:02.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:00.681555+0000 mgr.smithi099.zfglya (mgr.14180) 848 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 410 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 491 op/s 2024-02-19T22:18:02.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:00.681555+0000 mgr.smithi099.zfglya (mgr.14180) 848 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 410 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 491 op/s 2024-02-19T22:18:02.816 INFO:tasks.workunit.client.0.smithi099.stdout: 10 320585 46.59 MB/sec execute 247 sec latency 110.885 ms 2024-02-19T22:18:03.137 INFO:tasks.workunit.client.1.smithi138.stdout: 10 167417 23.40 MB/sec execute 251 sec latency 76.837 ms 2024-02-19T22:18:03.819 INFO:tasks.workunit.client.0.smithi099.stdout: 10 321926 46.65 MB/sec execute 248 sec latency 126.462 ms 2024-02-19T22:18:04.137 INFO:tasks.workunit.client.1.smithi138.stdout: 10 167741 23.35 MB/sec execute 252 sec latency 110.491 ms 2024-02-19T22:18:04.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:02.682093+0000 mgr.smithi099.zfglya (mgr.14180) 849 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 418 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 505 op/s 2024-02-19T22:18:04.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:02.682093+0000 mgr.smithi099.zfglya (mgr.14180) 849 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 418 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 505 op/s 2024-02-19T22:18:04.818 INFO:tasks.workunit.client.0.smithi099.stdout: 10 323478 46.83 MB/sec execute 249 sec latency 116.858 ms 2024-02-19T22:18:05.137 INFO:tasks.workunit.client.1.smithi138.stdout: 10 168118 23.35 MB/sec execute 253 sec latency 131.816 ms 2024-02-19T22:18:05.818 INFO:tasks.workunit.client.0.smithi099.stdout: 10 323606 46.66 MB/sec execute 250 sec latency 109.009 ms 2024-02-19T22:18:06.137 INFO:tasks.workunit.client.1.smithi138.stdout: 10 168541 23.31 MB/sec execute 254 sec latency 97.598 ms 2024-02-19T22:18:06.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:04.682521+0000 mgr.smithi099.zfglya (mgr.14180) 850 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 426 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 18 KiB/s rd, 10 MiB/s wr, 469 op/s 2024-02-19T22:18:06.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:04.682521+0000 mgr.smithi099.zfglya (mgr.14180) 850 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 426 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 18 KiB/s rd, 10 MiB/s wr, 469 op/s 2024-02-19T22:18:06.818 INFO:tasks.workunit.client.0.smithi099.stdout: 10 324686 46.67 MB/sec execute 251 sec latency 124.325 ms 2024-02-19T22:18:07.137 INFO:tasks.workunit.client.1.smithi138.stdout: 10 168982 23.31 MB/sec execute 255 sec latency 116.898 ms 2024-02-19T22:18:07.819 INFO:tasks.workunit.client.0.smithi099.stdout: 10 325929 46.79 MB/sec execute 252 sec latency 115.442 ms 2024-02-19T22:18:08.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 169426 23.31 MB/sec execute 256 sec latency 70.039 ms 2024-02-19T22:18:08.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:06.683056+0000 mgr.smithi099.zfglya (mgr.14180) 851 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 424 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 490 op/s 2024-02-19T22:18:08.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:06.683056+0000 mgr.smithi099.zfglya (mgr.14180) 851 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 424 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 490 op/s 2024-02-19T22:18:08.819 INFO:tasks.workunit.client.0.smithi099.stdout: 10 327071 46.85 MB/sec execute 253 sec latency 113.887 ms 2024-02-19T22:18:09.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 169924 23.34 MB/sec execute 257 sec latency 76.317 ms 2024-02-19T22:18:09.819 INFO:tasks.workunit.client.0.smithi099.stdout: 10 327249 46.69 MB/sec execute 254 sec latency 109.117 ms 2024-02-19T22:18:10.137 INFO:tasks.workunit.client.1.smithi138.stdout: 10 170317 23.39 MB/sec execute 258 sec latency 121.889 ms 2024-02-19T22:18:10.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:08.683626+0000 mgr.smithi099.zfglya (mgr.14180) 852 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 424 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 9.6 MiB/s wr, 517 op/s 2024-02-19T22:18:10.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:08.683626+0000 mgr.smithi099.zfglya (mgr.14180) 852 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 424 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 21 KiB/s rd, 9.6 MiB/s wr, 517 op/s 2024-02-19T22:18:10.819 INFO:tasks.workunit.client.0.smithi099.stdout: 10 328602 46.73 MB/sec execute 255 sec latency 142.630 ms 2024-02-19T22:18:11.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 170683 23.37 MB/sec execute 259 sec latency 86.337 ms 2024-02-19T22:18:11.820 INFO:tasks.workunit.client.0.smithi099.stdout: 10 329668 46.86 MB/sec execute 256 sec latency 114.238 ms 2024-02-19T22:18:12.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 171038 23.33 MB/sec execute 260 sec latency 105.669 ms 2024-02-19T22:18:12.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:10.684124+0000 mgr.smithi099.zfglya (mgr.14180) 853 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 422 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 503 op/s 2024-02-19T22:18:12.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:10.684124+0000 mgr.smithi099.zfglya (mgr.14180) 853 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 422 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 503 op/s 2024-02-19T22:18:12.820 INFO:tasks.workunit.client.0.smithi099.stdout: 10 330627 46.87 MB/sec execute 257 sec latency 106.038 ms 2024-02-19T22:18:13.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 171357 23.29 MB/sec execute 261 sec latency 120.607 ms 2024-02-19T22:18:13.820 INFO:tasks.workunit.client.0.smithi099.stdout: 10 330863 46.71 MB/sec execute 258 sec latency 94.653 ms 2024-02-19T22:18:14.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 171748 23.29 MB/sec execute 262 sec latency 144.316 ms 2024-02-19T22:18:14.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:12.684614+0000 mgr.smithi099.zfglya (mgr.14180) 854 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 428 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 486 op/s 2024-02-19T22:18:14.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:12.684614+0000 mgr.smithi099.zfglya (mgr.14180) 854 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 428 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 486 op/s 2024-02-19T22:18:14.820 INFO:tasks.workunit.client.0.smithi099.stdout: 10 332291 46.77 MB/sec execute 259 sec latency 124.634 ms 2024-02-19T22:18:15.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 172189 23.24 MB/sec execute 263 sec latency 89.610 ms 2024-02-19T22:18:15.820 INFO:tasks.workunit.client.0.smithi099.stdout: 10 333070 46.83 MB/sec execute 260 sec latency 383.078 ms 2024-02-19T22:18:16.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 172603 23.24 MB/sec execute 264 sec latency 152.732 ms 2024-02-19T22:18:16.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:14.685103+0000 mgr.smithi099.zfglya (mgr.14180) 855 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 425 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 18 KiB/s rd, 9.6 MiB/s wr, 439 op/s 2024-02-19T22:18:16.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:14.685103+0000 mgr.smithi099.zfglya (mgr.14180) 855 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 425 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 18 KiB/s rd, 9.6 MiB/s wr, 439 op/s 2024-02-19T22:18:16.820 INFO:tasks.workunit.client.0.smithi099.stdout: 10 334162 46.88 MB/sec execute 261 sec latency 129.819 ms 2024-02-19T22:18:17.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 173181 23.29 MB/sec execute 265 sec latency 31.146 ms 2024-02-19T22:18:17.821 INFO:tasks.workunit.client.0.smithi099.stdout: 10 334325 46.72 MB/sec execute 262 sec latency 108.566 ms 2024-02-19T22:18:18.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 173553 23.30 MB/sec execute 266 sec latency 109.262 ms 2024-02-19T22:18:18.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:16.685680+0000 mgr.smithi099.zfglya (mgr.14180) 856 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 415 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 446 op/s 2024-02-19T22:18:18.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:18:17.474009+0000 mon.smithi099 (mon.0) 822 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:18:18.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:18:17.936374+0000 mon.smithi099 (mon.0) 823 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:18:18.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:18:17.937200+0000 mon.smithi099 (mon.0) 824 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:18:18.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:18:17.941628+0000 mon.smithi099 (mon.0) 825 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:18:18.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:16.685680+0000 mgr.smithi099.zfglya (mgr.14180) 856 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 415 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 446 op/s 2024-02-19T22:18:18.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:18:17.474009+0000 mon.smithi099 (mon.0) 822 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:18:18.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:18:17.936374+0000 mon.smithi099 (mon.0) 823 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:18:18.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:18:17.937200+0000 mon.smithi099 (mon.0) 824 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:18:18.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:18:17.941628+0000 mon.smithi099 (mon.0) 825 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:18:18.821 INFO:tasks.workunit.client.0.smithi099.stdout: 10 335686 46.77 MB/sec execute 263 sec latency 136.392 ms 2024-02-19T22:18:19.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 173961 23.33 MB/sec execute 267 sec latency 123.572 ms 2024-02-19T22:18:19.824 INFO:tasks.workunit.client.0.smithi099.stdout: 10 336752 46.88 MB/sec execute 264 sec latency 119.779 ms 2024-02-19T22:18:20.139 INFO:tasks.workunit.client.1.smithi138.stdout: 10 174254 23.31 MB/sec execute 268 sec latency 107.270 ms 2024-02-19T22:18:20.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:18.686233+0000 mgr.smithi099.zfglya (mgr.14180) 857 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 417 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 9.8 MiB/s wr, 527 op/s 2024-02-19T22:18:20.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:18.686233+0000 mgr.smithi099.zfglya (mgr.14180) 857 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 417 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 9.8 MiB/s wr, 527 op/s 2024-02-19T22:18:20.824 INFO:tasks.workunit.client.0.smithi099.stdout: 10 337714 46.90 MB/sec execute 265 sec latency 234.142 ms 2024-02-19T22:18:21.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 174556 23.26 MB/sec execute 269 sec latency 91.126 ms 2024-02-19T22:18:21.824 INFO:tasks.workunit.client.0.smithi099.stdout: 10 337892 46.74 MB/sec execute 266 sec latency 106.737 ms 2024-02-19T22:18:22.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 174868 23.21 MB/sec execute 270 sec latency 94.597 ms 2024-02-19T22:18:22.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:20.686760+0000 mgr.smithi099.zfglya (mgr.14180) 858 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 415 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 450 op/s 2024-02-19T22:18:22.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:20.686760+0000 mgr.smithi099.zfglya (mgr.14180) 858 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 415 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 450 op/s 2024-02-19T22:18:22.824 INFO:tasks.workunit.client.0.smithi099.stdout: 10 339348 46.79 MB/sec execute 267 sec latency 111.284 ms 2024-02-19T22:18:23.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 175266 23.21 MB/sec execute 271 sec latency 118.567 ms 2024-02-19T22:18:23.824 INFO:tasks.workunit.client.0.smithi099.stdout: 10 340299 46.90 MB/sec execute 268 sec latency 121.638 ms 2024-02-19T22:18:24.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 175663 23.17 MB/sec execute 272 sec latency 97.762 ms 2024-02-19T22:18:24.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:22.687297+0000 mgr.smithi099.zfglya (mgr.14180) 859 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 421 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 509 op/s 2024-02-19T22:18:24.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:22.687297+0000 mgr.smithi099.zfglya (mgr.14180) 859 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 421 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 509 op/s 2024-02-19T22:18:24.824 INFO:tasks.workunit.client.0.smithi099.stdout: 10 341261 46.91 MB/sec execute 269 sec latency 111.915 ms 2024-02-19T22:18:25.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 176089 23.16 MB/sec execute 273 sec latency 154.006 ms 2024-02-19T22:18:25.825 INFO:tasks.workunit.client.0.smithi099.stdout: 10 341510 46.76 MB/sec execute 270 sec latency 119.602 ms 2024-02-19T22:18:26.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 176634 23.20 MB/sec execute 274 sec latency 76.632 ms 2024-02-19T22:18:26.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:24.687813+0000 mgr.smithi099.zfglya (mgr.14180) 860 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 421 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 9.3 MiB/s wr, 498 op/s 2024-02-19T22:18:26.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:24.687813+0000 mgr.smithi099.zfglya (mgr.14180) 860 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 421 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 19 KiB/s rd, 9.3 MiB/s wr, 498 op/s 2024-02-19T22:18:26.825 INFO:tasks.workunit.client.0.smithi099.stdout: 10 342681 46.78 MB/sec execute 271 sec latency 414.495 ms 2024-02-19T22:18:27.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 177085 23.23 MB/sec execute 275 sec latency 52.261 ms 2024-02-19T22:18:27.825 INFO:tasks.workunit.client.0.smithi099.stdout: 10 343820 46.91 MB/sec execute 272 sec latency 123.200 ms 2024-02-19T22:18:28.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 177505 23.27 MB/sec execute 276 sec latency 99.913 ms 2024-02-19T22:18:28.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:26.688288+0000 mgr.smithi099.zfglya (mgr.14180) 861 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 408 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 480 op/s 2024-02-19T22:18:28.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:26.688288+0000 mgr.smithi099.zfglya (mgr.14180) 861 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 408 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 480 op/s 2024-02-19T22:18:28.825 INFO:tasks.workunit.client.0.smithi099.stdout: 10 344808 46.92 MB/sec execute 273 sec latency 93.209 ms 2024-02-19T22:18:29.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 177854 23.24 MB/sec execute 277 sec latency 121.002 ms 2024-02-19T22:18:29.825 INFO:tasks.workunit.client.0.smithi099.stdout: 10 345044 46.77 MB/sec execute 274 sec latency 108.591 ms 2024-02-19T22:18:30.138 INFO:tasks.workunit.client.1.smithi138.stdout: 10 178167 23.20 MB/sec execute 278 sec latency 118.955 ms 2024-02-19T22:18:30.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:28.688841+0000 mgr.smithi099.zfglya (mgr.14180) 862 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 411 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 18 KiB/s rd, 10 MiB/s wr, 518 op/s 2024-02-19T22:18:30.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:28.688841+0000 mgr.smithi099.zfglya (mgr.14180) 862 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 411 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 18 KiB/s rd, 10 MiB/s wr, 518 op/s 2024-02-19T22:18:30.825 INFO:tasks.workunit.client.0.smithi099.stdout: 10 346464 46.83 MB/sec execute 275 sec latency 119.579 ms 2024-02-19T22:18:31.139 INFO:tasks.workunit.client.1.smithi138.stdout: 10 178627 23.20 MB/sec execute 279 sec latency 97.343 ms 2024-02-19T22:18:31.825 INFO:tasks.workunit.client.0.smithi099.stdout: 10 347399 46.92 MB/sec execute 276 sec latency 147.160 ms 2024-02-19T22:18:32.144 INFO:tasks.workunit.client.1.smithi138.stdout: 10 179003 23.18 MB/sec execute 280 sec latency 103.236 ms 2024-02-19T22:18:32.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:30.689338+0000 mgr.smithi099.zfglya (mgr.14180) 863 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 422 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 499 op/s 2024-02-19T22:18:32.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:30.689338+0000 mgr.smithi099.zfglya (mgr.14180) 863 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 422 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 499 op/s 2024-02-19T22:18:32.826 INFO:tasks.workunit.client.0.smithi099.stdout: 10 348288 46.93 MB/sec execute 277 sec latency 672.213 ms 2024-02-19T22:18:33.145 INFO:tasks.workunit.client.1.smithi138.stdout: 10 179402 23.14 MB/sec execute 281 sec latency 133.787 ms 2024-02-19T22:18:33.826 INFO:tasks.workunit.client.0.smithi099.stdout: 10 348291 46.76 MB/sec execute 278 sec latency 655.090 ms 2024-02-19T22:18:34.144 INFO:tasks.workunit.client.1.smithi138.stdout: 10 179884 23.15 MB/sec execute 282 sec latency 86.114 ms 2024-02-19T22:18:34.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:32.689826+0000 mgr.smithi099.zfglya (mgr.14180) 864 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 417 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 476 op/s 2024-02-19T22:18:34.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:32.689826+0000 mgr.smithi099.zfglya (mgr.14180) 864 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 417 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 476 op/s 2024-02-19T22:18:34.826 INFO:tasks.workunit.client.0.smithi099.stdout: 10 348297 46.59 MB/sec execute 279 sec latency 428.115 ms 2024-02-19T22:18:35.144 INFO:tasks.workunit.client.1.smithi138.stdout: 10 180448 23.19 MB/sec execute 283 sec latency 70.104 ms 2024-02-19T22:18:35.826 INFO:tasks.workunit.client.0.smithi099.stdout: 10 348349 46.43 MB/sec execute 280 sec latency 519.189 ms 2024-02-19T22:18:36.144 INFO:tasks.workunit.client.1.smithi138.stdout: 10 180931 23.26 MB/sec execute 284 sec latency 72.051 ms 2024-02-19T22:18:36.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:34.690431+0000 mgr.smithi099.zfglya (mgr.14180) 865 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 416 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 8.7 MiB/s wr, 432 op/s 2024-02-19T22:18:36.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:34.690431+0000 mgr.smithi099.zfglya (mgr.14180) 865 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 416 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 8.7 MiB/s wr, 432 op/s 2024-02-19T22:18:36.826 INFO:tasks.workunit.client.0.smithi099.stdout: 10 348850 46.36 MB/sec execute 281 sec latency 88.213 ms 2024-02-19T22:18:37.144 INFO:tasks.workunit.client.1.smithi138.stdout: 10 181308 23.25 MB/sec execute 285 sec latency 95.716 ms 2024-02-19T22:18:37.826 INFO:tasks.workunit.client.0.smithi099.stdout: 10 350232 46.42 MB/sec execute 282 sec latency 129.417 ms 2024-02-19T22:18:38.147 INFO:tasks.workunit.client.1.smithi138.stdout: 10 181618 23.21 MB/sec execute 286 sec latency 131.728 ms 2024-02-19T22:18:38.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:36.690903+0000 mgr.smithi099.zfglya (mgr.14180) 866 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 420 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 10 MiB/s wr, 462 op/s 2024-02-19T22:18:38.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:36.690903+0000 mgr.smithi099.zfglya (mgr.14180) 866 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 420 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 10 MiB/s wr, 462 op/s 2024-02-19T22:18:38.826 INFO:tasks.workunit.client.0.smithi099.stdout: 10 351838 46.61 MB/sec execute 283 sec latency 108.615 ms 2024-02-19T22:18:39.147 INFO:tasks.workunit.client.1.smithi138.stdout: 10 181973 23.17 MB/sec execute 287 sec latency 109.242 ms 2024-02-19T22:18:39.826 INFO:tasks.workunit.client.0.smithi099.stdout: 10 351964 46.46 MB/sec execute 284 sec latency 93.335 ms 2024-02-19T22:18:40.147 INFO:tasks.workunit.client.1.smithi138.stdout: 10 182296 23.15 MB/sec execute 288 sec latency 102.602 ms 2024-02-19T22:18:40.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:38.691458+0000 mgr.smithi099.zfglya (mgr.14180) 867 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 420 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 11 MiB/s wr, 557 op/s 2024-02-19T22:18:40.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:38.691458+0000 mgr.smithi099.zfglya (mgr.14180) 867 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 420 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 11 MiB/s wr, 557 op/s 2024-02-19T22:18:40.826 INFO:tasks.workunit.client.0.smithi099.stdout: 10 352923 46.46 MB/sec execute 285 sec latency 116.307 ms 2024-02-19T22:18:41.147 INFO:tasks.workunit.client.1.smithi138.stdout: 10 182690 23.13 MB/sec execute 289 sec latency 107.565 ms 2024-02-19T22:18:41.826 INFO:tasks.workunit.client.0.smithi099.stdout: 10 354152 46.55 MB/sec execute 286 sec latency 143.397 ms 2024-02-19T22:18:42.147 INFO:tasks.workunit.client.1.smithi138.stdout: 10 183136 23.12 MB/sec execute 290 sec latency 98.641 ms 2024-02-19T22:18:42.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:40.691993+0000 mgr.smithi099.zfglya (mgr.14180) 868 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 424 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 517 op/s 2024-02-19T22:18:42.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:40.691993+0000 mgr.smithi099.zfglya (mgr.14180) 868 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 424 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 12 MiB/s wr, 517 op/s 2024-02-19T22:18:42.826 INFO:tasks.workunit.client.0.smithi099.stdout: 10 355424 46.63 MB/sec execute 287 sec latency 101.270 ms 2024-02-19T22:18:43.147 INFO:tasks.workunit.client.1.smithi138.stdout: 10 183632 23.13 MB/sec execute 291 sec latency 76.692 ms 2024-02-19T22:18:43.826 INFO:tasks.workunit.client.0.smithi099.stdout: 10 355586 46.48 MB/sec execute 288 sec latency 97.718 ms 2024-02-19T22:18:44.147 INFO:tasks.workunit.client.1.smithi138.stdout: 10 184162 23.18 MB/sec execute 292 sec latency 74.499 ms 2024-02-19T22:18:44.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:42.692536+0000 mgr.smithi099.zfglya (mgr.14180) 869 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 416 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 9.7 MiB/s wr, 449 op/s 2024-02-19T22:18:44.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:42.692536+0000 mgr.smithi099.zfglya (mgr.14180) 869 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 416 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 14 KiB/s rd, 9.7 MiB/s wr, 449 op/s 2024-02-19T22:18:44.828 INFO:tasks.workunit.client.0.smithi099.stdout: 10 357061 46.54 MB/sec execute 289 sec latency 111.104 ms 2024-02-19T22:18:45.147 INFO:tasks.workunit.client.1.smithi138.stdout: 10 184640 23.23 MB/sec execute 293 sec latency 107.249 ms 2024-02-19T22:18:45.830 INFO:tasks.workunit.client.0.smithi099.stdout: 10 358481 46.72 MB/sec execute 290 sec latency 129.244 ms 2024-02-19T22:18:46.147 INFO:tasks.workunit.client.1.smithi138.stdout: 10 184995 23.21 MB/sec execute 294 sec latency 96.614 ms 2024-02-19T22:18:46.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:44.693061+0000 mgr.smithi099.zfglya (mgr.14180) 870 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 413 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 9.6 MiB/s wr, 551 op/s 2024-02-19T22:18:46.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:44.693061+0000 mgr.smithi099.zfglya (mgr.14180) 870 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 413 MiB data, 6.6 GiB used, 709 GiB / 715 GiB avail; 20 KiB/s rd, 9.6 MiB/s wr, 551 op/s 2024-02-19T22:18:46.829 INFO:tasks.workunit.client.0.smithi099.stdout: 10 358992 46.65 MB/sec execute 291 sec latency 293.834 ms 2024-02-19T22:18:47.148 INFO:tasks.workunit.client.1.smithi138.stdout: 10 185366 23.17 MB/sec execute 295 sec latency 90.373 ms 2024-02-19T22:18:47.829 INFO:tasks.workunit.client.0.smithi099.stdout: 10 359812 46.65 MB/sec execute 292 sec latency 94.790 ms 2024-02-19T22:18:48.148 INFO:tasks.workunit.client.1.smithi138.stdout: 10 185761 23.17 MB/sec execute 296 sec latency 134.211 ms 2024-02-19T22:18:48.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:46.693514+0000 mgr.smithi099.zfglya (mgr.14180) 871 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 412 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 529 op/s 2024-02-19T22:18:48.720 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:46.693514+0000 mgr.smithi099.zfglya (mgr.14180) 871 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 412 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 529 op/s 2024-02-19T22:18:48.829 INFO:tasks.workunit.client.0.smithi099.stdout: 10 361198 46.75 MB/sec execute 293 sec latency 125.623 ms 2024-02-19T22:18:49.148 INFO:tasks.workunit.client.1.smithi138.stdout: 10 186070 23.14 MB/sec execute 297 sec latency 142.298 ms 2024-02-19T22:18:49.829 INFO:tasks.workunit.client.0.smithi099.stdout: 10 362478 46.82 MB/sec execute 294 sec latency 94.175 ms 2024-02-19T22:18:50.148 INFO:tasks.workunit.client.1.smithi138.stdout: 10 186395 23.10 MB/sec execute 298 sec latency 116.704 ms 2024-02-19T22:18:50.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:48.694040+0000 mgr.smithi099.zfglya (mgr.14180) 872 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 420 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 18 KiB/s rd, 11 MiB/s wr, 520 op/s 2024-02-19T22:18:50.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:48.694040+0000 mgr.smithi099.zfglya (mgr.14180) 872 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 420 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 18 KiB/s rd, 11 MiB/s wr, 520 op/s 2024-02-19T22:18:50.831 INFO:tasks.workunit.client.0.smithi099.stdout: 10 362639 46.67 MB/sec execute 295 sec latency 104.190 ms 2024-02-19T22:18:51.148 INFO:tasks.workunit.client.1.smithi138.stdout: 10 186834 23.09 MB/sec execute 299 sec latency 72.454 ms 2024-02-19T22:18:51.832 INFO:tasks.workunit.client.0.smithi099.stdout: 10 363631 46.68 MB/sec execute 296 sec latency 303.900 ms 2024-02-19T22:18:52.148 INFO:tasks.workunit.client.1.smithi138.stdout: 10 187275 23.09 MB/sec execute 300 sec latency 78.905 ms 2024-02-19T22:18:52.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:50.694620+0000 mgr.smithi099.zfglya (mgr.14180) 873 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 416 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 468 op/s 2024-02-19T22:18:52.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:50.694620+0000 mgr.smithi099.zfglya (mgr.14180) 873 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 416 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 468 op/s 2024-02-19T22:18:52.832 INFO:tasks.workunit.client.0.smithi099.stdout: 10 364887 46.77 MB/sec execute 297 sec latency 115.058 ms 2024-02-19T22:18:53.149 INFO:tasks.workunit.client.1.smithi138.stdout: 10 187689 23.11 MB/sec execute 301 sec latency 106.935 ms 2024-02-19T22:18:53.832 INFO:tasks.workunit.client.0.smithi099.stdout: 10 366073 46.83 MB/sec execute 298 sec latency 116.881 ms 2024-02-19T22:18:54.148 INFO:tasks.workunit.client.1.smithi138.stdout: 10 188062 23.15 MB/sec execute 302 sec latency 109.180 ms 2024-02-19T22:18:54.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:52.695084+0000 mgr.smithi099.zfglya (mgr.14180) 874 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 409 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 524 op/s 2024-02-19T22:18:54.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:52.695084+0000 mgr.smithi099.zfglya (mgr.14180) 874 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 409 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 524 op/s 2024-02-19T22:18:54.832 INFO:tasks.workunit.client.0.smithi099.stdout: 10 366264 46.69 MB/sec execute 299 sec latency 98.449 ms 2024-02-19T22:18:55.149 INFO:tasks.workunit.client.1.smithi138.stdout: 10 188468 23.13 MB/sec execute 303 sec latency 81.557 ms 2024-02-19T22:18:55.833 INFO:tasks.workunit.client.0.smithi099.stdout: 10 367737 46.75 MB/sec execute 300 sec latency 118.159 ms 2024-02-19T22:18:56.148 INFO:tasks.workunit.client.1.smithi138.stdout: 10 188847 23.11 MB/sec execute 304 sec latency 80.462 ms 2024-02-19T22:18:56.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:54.695540+0000 mgr.smithi099.zfglya (mgr.14180) 875 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 409 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 18 KiB/s rd, 9.6 MiB/s wr, 507 op/s 2024-02-19T22:18:56.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:54.695540+0000 mgr.smithi099.zfglya (mgr.14180) 875 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 409 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 18 KiB/s rd, 9.6 MiB/s wr, 507 op/s 2024-02-19T22:18:56.833 INFO:tasks.workunit.client.0.smithi099.stdout: 10 369383 46.97 MB/sec execute 301 sec latency 117.703 ms 2024-02-19T22:18:57.149 INFO:tasks.workunit.client.1.smithi138.stdout: 10 189155 23.09 MB/sec execute 305 sec latency 111.503 ms 2024-02-19T22:18:57.833 INFO:tasks.workunit.client.0.smithi099.stdout: 10 369621 46.85 MB/sec execute 302 sec latency 378.825 ms 2024-02-19T22:18:58.149 INFO:tasks.workunit.client.1.smithi138.stdout: 10 189476 23.04 MB/sec execute 306 sec latency 94.549 ms 2024-02-19T22:18:58.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:18:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:56.696075+0000 mgr.smithi099.zfglya (mgr.14180) 876 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 422 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 467 op/s 2024-02-19T22:18:58.704 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:18:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:56.696075+0000 mgr.smithi099.zfglya (mgr.14180) 876 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 422 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 467 op/s 2024-02-19T22:18:58.833 INFO:tasks.workunit.client.0.smithi099.stdout: 10 369841 46.71 MB/sec execute 303 sec latency 89.252 ms 2024-02-19T22:18:59.149 INFO:tasks.workunit.client.1.smithi138.stdout: 10 189878 23.04 MB/sec execute 307 sec latency 87.381 ms 2024-02-19T22:18:59.833 INFO:tasks.workunit.client.0.smithi099.stdout: 10 371494 46.83 MB/sec execute 304 sec latency 106.537 ms 2024-02-19T22:19:00.149 INFO:tasks.workunit.client.1.smithi138.stdout: 10 190316 23.03 MB/sec execute 308 sec latency 64.539 ms 2024-02-19T22:19:00.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:18:58.696597+0000 mgr.smithi099.zfglya (mgr.14180) 877 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 421 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 19 KiB/s rd, 10 MiB/s wr, 508 op/s 2024-02-19T22:19:00.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:18:58.696597+0000 mgr.smithi099.zfglya (mgr.14180) 877 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 421 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 19 KiB/s rd, 10 MiB/s wr, 508 op/s 2024-02-19T22:19:00.833 INFO:tasks.workunit.client.0.smithi099.stdout: 10 373111 47.01 MB/sec execute 305 sec latency 127.691 ms 2024-02-19T22:19:01.149 INFO:tasks.workunit.client.1.smithi138.stdout: 10 190824 23.03 MB/sec execute 309 sec latency 71.019 ms 2024-02-19T22:19:01.835 INFO:tasks.workunit.client.0.smithi099.stdout: 10 373236 46.87 MB/sec execute 306 sec latency 116.909 ms 2024-02-19T22:19:02.149 INFO:tasks.workunit.client.1.smithi138.stdout: 10 191217 23.05 MB/sec execute 310 sec latency 109.596 ms 2024-02-19T22:19:02.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:00.697068+0000 mgr.smithi099.zfglya (mgr.14180) 878 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 413 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 13 KiB/s rd, 9.9 MiB/s wr, 470 op/s 2024-02-19T22:19:02.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:00.697068+0000 mgr.smithi099.zfglya (mgr.14180) 878 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 413 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 13 KiB/s rd, 9.9 MiB/s wr, 470 op/s 2024-02-19T22:19:02.835 INFO:tasks.workunit.client.0.smithi099.stdout: 10 374170 46.87 MB/sec execute 307 sec latency 121.651 ms 2024-02-19T22:19:03.149 INFO:tasks.workunit.client.1.smithi138.stdout: 10 191606 23.09 MB/sec execute 311 sec latency 70.803 ms 2024-02-19T22:19:03.835 INFO:tasks.workunit.client.0.smithi099.stdout: 10 375408 46.95 MB/sec execute 308 sec latency 121.942 ms 2024-02-19T22:19:04.149 INFO:tasks.workunit.client.1.smithi138.stdout: 10 191958 23.07 MB/sec execute 312 sec latency 78.139 ms 2024-02-19T22:19:04.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:02.697516+0000 mgr.smithi099.zfglya (mgr.14180) 879 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 405 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 13 KiB/s rd, 9.2 MiB/s wr, 442 op/s 2024-02-19T22:19:04.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:02.697516+0000 mgr.smithi099.zfglya (mgr.14180) 879 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 405 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 13 KiB/s rd, 9.2 MiB/s wr, 442 op/s 2024-02-19T22:19:04.835 INFO:tasks.workunit.client.0.smithi099.stdout: 10 376660 47.02 MB/sec execute 309 sec latency 110.889 ms 2024-02-19T22:19:05.149 INFO:tasks.workunit.client.1.smithi138.stdout: 10 192321 23.05 MB/sec execute 313 sec latency 88.941 ms 2024-02-19T22:19:05.838 INFO:tasks.workunit.client.0.smithi099.stdout: 10 376785 46.88 MB/sec execute 310 sec latency 111.669 ms 2024-02-19T22:19:06.152 INFO:tasks.workunit.client.1.smithi138.stdout: 10 192647 23.03 MB/sec execute 314 sec latency 128.108 ms 2024-02-19T22:19:06.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:04.698030+0000 mgr.smithi099.zfglya (mgr.14180) 880 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 404 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 403 op/s 2024-02-19T22:19:06.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:04.698030+0000 mgr.smithi099.zfglya (mgr.14180) 880 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 404 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 403 op/s 2024-02-19T22:19:06.838 INFO:tasks.workunit.client.0.smithi099.stdout: 10 377903 46.89 MB/sec execute 311 sec latency 109.230 ms 2024-02-19T22:19:07.152 INFO:tasks.workunit.client.1.smithi138.stdout: 10 193038 23.00 MB/sec execute 315 sec latency 123.921 ms 2024-02-19T22:19:07.841 INFO:tasks.workunit.client.0.smithi099.stdout: 10 378994 46.96 MB/sec execute 312 sec latency 299.521 ms 2024-02-19T22:19:08.152 INFO:tasks.workunit.client.1.smithi138.stdout: 10 193439 22.99 MB/sec execute 316 sec latency 118.154 ms 2024-02-19T22:19:08.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:06.698540+0000 mgr.smithi099.zfglya (mgr.14180) 881 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 417 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 422 op/s 2024-02-19T22:19:08.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:06.698540+0000 mgr.smithi099.zfglya (mgr.14180) 881 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 417 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 422 op/s 2024-02-19T22:19:08.840 INFO:tasks.workunit.client.0.smithi099.stdout: 10 379218 46.85 MB/sec execute 313 sec latency 591.206 ms 2024-02-19T22:19:09.153 INFO:tasks.workunit.client.1.smithi138.stdout: 10 193877 22.99 MB/sec execute 317 sec latency 100.480 ms 2024-02-19T22:19:09.840 INFO:tasks.workunit.client.0.smithi099.stdout: 10 379326 46.72 MB/sec execute 314 sec latency 581.242 ms 2024-02-19T22:19:10.153 INFO:tasks.workunit.client.1.smithi138.stdout: 10 194374 22.98 MB/sec execute 318 sec latency 76.572 ms 2024-02-19T22:19:10.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:08.699018+0000 mgr.smithi099.zfglya (mgr.14180) 882 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 418 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 482 op/s 2024-02-19T22:19:10.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:08.699018+0000 mgr.smithi099.zfglya (mgr.14180) 882 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 418 MiB data, 6.9 GiB used, 708 GiB / 715 GiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 482 op/s 2024-02-19T22:19:10.842 INFO:tasks.workunit.client.0.smithi099.stdout: 10 379702 46.64 MB/sec execute 315 sec latency 692.374 ms 2024-02-19T22:19:11.153 INFO:tasks.workunit.client.1.smithi138.stdout: 10 194818 23.02 MB/sec execute 319 sec latency 78.163 ms 2024-02-19T22:19:11.843 INFO:tasks.workunit.client.0.smithi099.stdout: 10 380297 46.59 MB/sec execute 316 sec latency 394.496 ms 2024-02-19T22:19:12.153 INFO:tasks.workunit.client.1.smithi138.stdout: 10 195283 23.06 MB/sec execute 320 sec latency 117.749 ms 2024-02-19T22:19:12.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:10.699534+0000 mgr.smithi099.zfglya (mgr.14180) 883 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 408 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.7 MiB/s wr, 451 op/s 2024-02-19T22:19:12.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:10.699534+0000 mgr.smithi099.zfglya (mgr.14180) 883 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 408 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.7 MiB/s wr, 451 op/s 2024-02-19T22:19:12.842 INFO:tasks.workunit.client.0.smithi099.stdout: 10 380513 46.46 MB/sec execute 317 sec latency 88.675 ms 2024-02-19T22:19:13.153 INFO:tasks.workunit.client.1.smithi138.stdout: 10 195616 23.03 MB/sec execute 321 sec latency 130.559 ms 2024-02-19T22:19:13.843 INFO:tasks.workunit.client.0.smithi099.stdout: 10 381993 46.51 MB/sec execute 318 sec latency 129.781 ms 2024-02-19T22:19:14.153 INFO:tasks.workunit.client.1.smithi138.stdout: 10 196084 23.03 MB/sec execute 322 sec latency 26.830 ms 2024-02-19T22:19:14.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:12.700039+0000 mgr.smithi099.zfglya (mgr.14180) 884 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 412 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 489 op/s 2024-02-19T22:19:14.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:12.700039+0000 mgr.smithi099.zfglya (mgr.14180) 884 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 412 MiB data, 6.8 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 489 op/s 2024-02-19T22:19:14.843 INFO:tasks.workunit.client.0.smithi099.stdout: 10 383337 46.67 MB/sec execute 319 sec latency 111.543 ms 2024-02-19T22:19:15.153 INFO:tasks.workunit.client.1.smithi138.stdout: 10 196462 23.01 MB/sec execute 323 sec latency 108.579 ms 2024-02-19T22:19:15.844 INFO:tasks.workunit.client.0.smithi099.stdout: 10 383876 46.61 MB/sec execute 320 sec latency 119.185 ms 2024-02-19T22:19:16.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 196836 22.99 MB/sec execute 324 sec latency 131.622 ms 2024-02-19T22:19:16.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:14.700510+0000 mgr.smithi099.zfglya (mgr.14180) 885 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 418 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 18 KiB/s rd, 10 MiB/s wr, 528 op/s 2024-02-19T22:19:16.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:14.700510+0000 mgr.smithi099.zfglya (mgr.14180) 885 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 418 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 18 KiB/s rd, 10 MiB/s wr, 528 op/s 2024-02-19T22:19:16.844 INFO:tasks.workunit.client.0.smithi099.stdout: 10 384363 46.54 MB/sec execute 321 sec latency 119.809 ms 2024-02-19T22:19:17.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 197228 22.97 MB/sec execute 325 sec latency 126.373 ms 2024-02-19T22:19:17.844 INFO:tasks.workunit.client.0.smithi099.stdout: 10 385904 46.64 MB/sec execute 322 sec latency 120.768 ms 2024-02-19T22:19:18.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 197760 22.98 MB/sec execute 326 sec latency 83.856 ms 2024-02-19T22:19:18.545 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:16.700974+0000 mgr.smithi099.zfglya (mgr.14180) 886 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 421 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 531 op/s 2024-02-19T22:19:18.545 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:19:17.947593+0000 mon.smithi099 (mon.0) 826 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:19:18.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:16.700974+0000 mgr.smithi099.zfglya (mgr.14180) 886 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 421 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 13 KiB/s rd, 12 MiB/s wr, 531 op/s 2024-02-19T22:19:18.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:19:17.947593+0000 mon.smithi099 (mon.0) 826 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:19:18.844 INFO:tasks.workunit.client.0.smithi099.stdout: 10 387357 46.76 MB/sec execute 323 sec latency 124.947 ms 2024-02-19T22:19:19.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 198209 23.01 MB/sec execute 327 sec latency 114.182 ms 2024-02-19T22:19:19.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 387481 46.62 MB/sec execute 324 sec latency 106.864 ms 2024-02-19T22:19:20.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 198634 23.04 MB/sec execute 328 sec latency 117.574 ms 2024-02-19T22:19:20.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:18.701442+0000 mgr.smithi099.zfglya (mgr.14180) 887 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 410 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 20 KiB/s rd, 10 MiB/s wr, 558 op/s 2024-02-19T22:19:20.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:18.701442+0000 mgr.smithi099.zfglya (mgr.14180) 887 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 410 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 20 KiB/s rd, 10 MiB/s wr, 558 op/s 2024-02-19T22:19:20.844 INFO:tasks.workunit.client.0.smithi099.stdout: 10 388269 46.62 MB/sec execute 325 sec latency 114.581 ms 2024-02-19T22:19:21.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 199001 23.03 MB/sec execute 329 sec latency 109.739 ms 2024-02-19T22:19:21.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 389416 46.65 MB/sec execute 326 sec latency 133.383 ms 2024-02-19T22:19:21.951 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:19:20.644008+0000 mon.smithi099 (mon.0) 827 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:19:21.951 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:20.702012+0000 mgr.smithi099.zfglya (mgr.14180) 888 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 410 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 502 op/s 2024-02-19T22:19:22.043 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:19:20.644008+0000 mon.smithi099 (mon.0) 827 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:19:22.044 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:20.702012+0000 mgr.smithi099.zfglya (mgr.14180) 888 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 410 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 502 op/s 2024-02-19T22:19:22.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 199352 23.01 MB/sec execute 330 sec latency 109.883 ms 2024-02-19T22:19:22.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 389985 46.62 MB/sec execute 327 sec latency 375.929 ms 2024-02-19T22:19:23.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 199581 22.97 MB/sec execute 331 sec latency 159.337 ms 2024-02-19T22:19:23.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 390956 46.63 MB/sec execute 328 sec latency 143.984 ms 2024-02-19T22:19:24.045 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:22.702465+0000 mgr.smithi099.zfglya (mgr.14180) 889 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 412 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 463 op/s 2024-02-19T22:19:24.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 199932 22.96 MB/sec execute 332 sec latency 145.035 ms 2024-02-19T22:19:24.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:22.702465+0000 mgr.smithi099.zfglya (mgr.14180) 889 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 412 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 463 op/s 2024-02-19T22:19:24.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 391133 46.50 MB/sec execute 329 sec latency 101.651 ms 2024-02-19T22:19:25.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 200287 22.93 MB/sec execute 333 sec latency 120.401 ms 2024-02-19T22:19:25.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 392294 46.52 MB/sec execute 330 sec latency 175.196 ms 2024-02-19T22:19:26.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:24.702863+0000 mgr.smithi099.zfglya (mgr.14180) 890 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 417 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 20 KiB/s rd, 9.7 MiB/s wr, 467 op/s 2024-02-19T22:19:26.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 200646 22.90 MB/sec execute 334 sec latency 113.828 ms 2024-02-19T22:19:26.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:24.702863+0000 mgr.smithi099.zfglya (mgr.14180) 890 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 417 MiB data, 7.1 GiB used, 708 GiB / 715 GiB avail; 20 KiB/s rd, 9.7 MiB/s wr, 467 op/s 2024-02-19T22:19:26.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 393393 46.61 MB/sec execute 331 sec latency 142.251 ms 2024-02-19T22:19:27.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 201083 22.91 MB/sec execute 335 sec latency 118.707 ms 2024-02-19T22:19:27.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 394450 46.64 MB/sec execute 332 sec latency 343.416 ms 2024-02-19T22:19:28.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:26.703445+0000 mgr.smithi099.zfglya (mgr.14180) 891 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 414 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 14 KiB/s rd, 10 MiB/s wr, 446 op/s 2024-02-19T22:19:28.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 201642 22.94 MB/sec execute 336 sec latency 76.320 ms 2024-02-19T22:19:28.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:26.703445+0000 mgr.smithi099.zfglya (mgr.14180) 891 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 414 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 14 KiB/s rd, 10 MiB/s wr, 446 op/s 2024-02-19T22:19:28.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 394563 46.51 MB/sec execute 333 sec latency 375.978 ms 2024-02-19T22:19:29.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 202103 22.97 MB/sec execute 337 sec latency 83.662 ms 2024-02-19T22:19:29.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 395166 46.47 MB/sec execute 334 sec latency 109.654 ms 2024-02-19T22:19:30.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:28.703998+0000 mgr.smithi099.zfglya (mgr.14180) 892 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 405 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 18 KiB/s rd, 9.0 MiB/s wr, 457 op/s 2024-02-19T22:19:30.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 202532 22.98 MB/sec execute 338 sec latency 111.681 ms 2024-02-19T22:19:30.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:28.703998+0000 mgr.smithi099.zfglya (mgr.14180) 892 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 405 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 18 KiB/s rd, 9.0 MiB/s wr, 457 op/s 2024-02-19T22:19:30.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 396342 46.48 MB/sec execute 335 sec latency 134.314 ms 2024-02-19T22:19:31.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 202855 22.96 MB/sec execute 339 sec latency 130.603 ms 2024-02-19T22:19:31.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 397721 46.61 MB/sec execute 336 sec latency 134.022 ms 2024-02-19T22:19:32.043 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:30.704481+0000 mgr.smithi099.zfglya (mgr.14180) 893 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 413 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 467 op/s 2024-02-19T22:19:32.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 203143 22.92 MB/sec execute 340 sec latency 115.841 ms 2024-02-19T22:19:32.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:30.704481+0000 mgr.smithi099.zfglya (mgr.14180) 893 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 413 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 467 op/s 2024-02-19T22:19:32.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 398099 46.53 MB/sec execute 337 sec latency 109.710 ms 2024-02-19T22:19:33.156 INFO:tasks.workunit.client.1.smithi138.stdout: 10 203520 22.92 MB/sec execute 341 sec latency 130.311 ms 2024-02-19T22:19:33.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:19:32.000209+0000 mon.smithi099 (mon.0) 828 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:19:33.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:19:32.459832+0000 mon.smithi099 (mon.0) 829 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:19:33.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:19:32.460684+0000 mon.smithi099 (mon.0) 830 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:19:33.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:19:32.466234+0000 mon.smithi099 (mon.0) 831 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:19:33.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:19:32.000209+0000 mon.smithi099 (mon.0) 828 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:19:33.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:19:32.459832+0000 mon.smithi099 (mon.0) 829 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:19:33.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:19:32.460684+0000 mon.smithi099 (mon.0) 830 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:19:33.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:19:32.466234+0000 mon.smithi099 (mon.0) 831 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:19:33.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 398367 46.41 MB/sec execute 338 sec latency 225.263 ms 2024-02-19T22:19:34.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 203889 22.89 MB/sec execute 342 sec latency 126.001 ms 2024-02-19T22:19:34.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:32.704955+0000 mgr.smithi099.zfglya (mgr.14180) 894 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 420 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 450 op/s 2024-02-19T22:19:34.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:32.704955+0000 mgr.smithi099.zfglya (mgr.14180) 894 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 420 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 450 op/s 2024-02-19T22:19:34.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 399749 46.46 MB/sec execute 339 sec latency 118.278 ms 2024-02-19T22:19:35.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 204283 22.87 MB/sec execute 343 sec latency 92.994 ms 2024-02-19T22:19:35.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 401269 46.63 MB/sec execute 340 sec latency 116.428 ms 2024-02-19T22:19:36.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 204701 22.88 MB/sec execute 344 sec latency 128.205 ms 2024-02-19T22:19:36.294 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:34.705370+0000 mgr.smithi099.zfglya (mgr.14180) 895 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 421 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 18 KiB/s rd, 9.3 MiB/s wr, 491 op/s 2024-02-19T22:19:36.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:34.705370+0000 mgr.smithi099.zfglya (mgr.14180) 895 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 421 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 18 KiB/s rd, 9.3 MiB/s wr, 491 op/s 2024-02-19T22:19:36.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 401661 46.54 MB/sec execute 341 sec latency 111.807 ms 2024-02-19T22:19:37.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 205143 22.89 MB/sec execute 345 sec latency 93.676 ms 2024-02-19T22:19:37.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 402452 46.54 MB/sec execute 342 sec latency 97.444 ms 2024-02-19T22:19:38.155 INFO:tasks.workunit.client.1.smithi138.stdout: 10 205614 22.91 MB/sec execute 346 sec latency 28.712 ms 2024-02-19T22:19:38.295 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:36.705949+0000 mgr.smithi099.zfglya (mgr.14180) 896 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 417 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 11 KiB/s rd, 10 MiB/s wr, 470 op/s 2024-02-19T22:19:38.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:36.705949+0000 mgr.smithi099.zfglya (mgr.14180) 896 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 417 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 11 KiB/s rd, 10 MiB/s wr, 470 op/s 2024-02-19T22:19:38.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 403776 46.61 MB/sec execute 343 sec latency 119.354 ms 2024-02-19T22:19:39.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 206108 22.94 MB/sec execute 347 sec latency 65.899 ms 2024-02-19T22:19:39.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 405084 46.68 MB/sec execute 344 sec latency 119.584 ms 2024-02-19T22:19:40.154 INFO:tasks.workunit.client.1.smithi138.stdout: 10 206394 22.91 MB/sec execute 348 sec latency 132.462 ms 2024-02-19T22:19:40.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:38.706533+0000 mgr.smithi099.zfglya (mgr.14180) 897 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 422 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 17 KiB/s rd, 9.8 MiB/s wr, 475 op/s 2024-02-19T22:19:40.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:38.706533+0000 mgr.smithi099.zfglya (mgr.14180) 897 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 422 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 17 KiB/s rd, 9.8 MiB/s wr, 475 op/s 2024-02-19T22:19:40.847 INFO:tasks.workunit.client.0.smithi099.stdout: 10 405208 46.56 MB/sec execute 345 sec latency 99.510 ms 2024-02-19T22:19:41.155 INFO:tasks.workunit.client.1.smithi138.stdout: 10 206694 22.89 MB/sec execute 349 sec latency 111.154 ms 2024-02-19T22:19:41.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 406215 46.56 MB/sec execute 346 sec latency 108.149 ms 2024-02-19T22:19:42.156 INFO:tasks.workunit.client.1.smithi138.stdout: 10 207115 22.87 MB/sec execute 350 sec latency 114.126 ms 2024-02-19T22:19:42.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:40.707057+0000 mgr.smithi099.zfglya (mgr.14180) 898 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 425 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 445 op/s 2024-02-19T22:19:42.452 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:40.707057+0000 mgr.smithi099.zfglya (mgr.14180) 898 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 425 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 445 op/s 2024-02-19T22:19:42.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 407575 46.66 MB/sec execute 347 sec latency 126.770 ms 2024-02-19T22:19:43.156 INFO:tasks.workunit.client.1.smithi138.stdout: 10 207512 22.86 MB/sec execute 351 sec latency 119.432 ms 2024-02-19T22:19:43.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 408629 46.70 MB/sec execute 348 sec latency 396.966 ms 2024-02-19T22:19:44.156 INFO:tasks.workunit.client.1.smithi138.stdout: 10 207862 22.83 MB/sec execute 352 sec latency 120.611 ms 2024-02-19T22:19:44.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:42.707641+0000 mgr.smithi099.zfglya (mgr.14180) 899 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 429 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 482 op/s 2024-02-19T22:19:44.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:42.707641+0000 mgr.smithi099.zfglya (mgr.14180) 899 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 429 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 482 op/s 2024-02-19T22:19:44.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 408632 46.56 MB/sec execute 349 sec latency 683.438 ms 2024-02-19T22:19:45.157 INFO:tasks.workunit.client.1.smithi138.stdout: 10 208250 22.84 MB/sec execute 353 sec latency 108.217 ms 2024-02-19T22:19:45.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 408658 46.43 MB/sec execute 350 sec latency 580.337 ms 2024-02-19T22:19:46.156 INFO:tasks.workunit.client.1.smithi138.stdout: 10 208714 22.85 MB/sec execute 354 sec latency 101.831 ms 2024-02-19T22:19:46.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:44.708165+0000 mgr.smithi099.zfglya (mgr.14180) 900 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 427 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 19 KiB/s rd, 9.1 MiB/s wr, 479 op/s 2024-02-19T22:19:46.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:44.708165+0000 mgr.smithi099.zfglya (mgr.14180) 900 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 427 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 19 KiB/s rd, 9.1 MiB/s wr, 479 op/s 2024-02-19T22:19:46.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 408685 46.30 MB/sec execute 351 sec latency 419.305 ms 2024-02-19T22:19:47.157 INFO:tasks.workunit.client.1.smithi138.stdout: 10 209140 22.86 MB/sec execute 355 sec latency 117.861 ms 2024-02-19T22:19:47.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 408852 46.18 MB/sec execute 352 sec latency 421.913 ms 2024-02-19T22:19:48.157 INFO:tasks.workunit.client.1.smithi138.stdout: 10 209648 22.90 MB/sec execute 356 sec latency 62.669 ms 2024-02-19T22:19:48.452 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:46.708626+0000 mgr.smithi099.zfglya (mgr.14180) 901 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 423 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 514 op/s 2024-02-19T22:19:48.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:46.708626+0000 mgr.smithi099.zfglya (mgr.14180) 901 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 423 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 514 op/s 2024-02-19T22:19:48.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 410220 46.22 MB/sec execute 353 sec latency 108.502 ms 2024-02-19T22:19:49.158 INFO:tasks.workunit.client.1.smithi138.stdout: 10 209977 22.87 MB/sec execute 357 sec latency 68.667 ms 2024-02-19T22:19:49.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 411270 46.31 MB/sec execute 354 sec latency 123.314 ms 2024-02-19T22:19:50.157 INFO:tasks.workunit.client.1.smithi138.stdout: 10 210253 22.85 MB/sec execute 358 sec latency 133.167 ms 2024-02-19T22:19:50.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:48.709088+0000 mgr.smithi099.zfglya (mgr.14180) 902 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 424 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 18 KiB/s rd, 10 MiB/s wr, 516 op/s 2024-02-19T22:19:50.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:48.709088+0000 mgr.smithi099.zfglya (mgr.14180) 902 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 424 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 18 KiB/s rd, 10 MiB/s wr, 516 op/s 2024-02-19T22:19:50.845 INFO:tasks.workunit.client.0.smithi099.stdout: 10 412233 46.32 MB/sec execute 355 sec latency 127.770 ms 2024-02-19T22:19:51.157 INFO:tasks.workunit.client.1.smithi138.stdout: 10 210571 22.83 MB/sec execute 359 sec latency 94.661 ms 2024-02-19T22:19:51.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 412681 46.25 MB/sec execute 356 sec latency 95.835 ms 2024-02-19T22:19:52.157 INFO:tasks.workunit.client.1.smithi138.stdout: 10 210957 22.81 MB/sec execute 360 sec latency 108.789 ms 2024-02-19T22:19:52.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:50.709740+0000 mgr.smithi099.zfglya (mgr.14180) 903 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 421 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 466 op/s 2024-02-19T22:19:52.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:50.709740+0000 mgr.smithi099.zfglya (mgr.14180) 903 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 421 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 466 op/s 2024-02-19T22:19:52.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 413884 46.25 MB/sec execute 357 sec latency 182.992 ms 2024-02-19T22:19:53.162 INFO:tasks.workunit.client.1.smithi138.stdout: 10 211361 22.78 MB/sec execute 361 sec latency 86.646 ms 2024-02-19T22:19:53.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 415451 46.42 MB/sec execute 358 sec latency 109.082 ms 2024-02-19T22:19:54.162 INFO:tasks.workunit.client.1.smithi138.stdout: 10 211767 22.80 MB/sec execute 362 sec latency 159.048 ms 2024-02-19T22:19:54.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:52.710208+0000 mgr.smithi099.zfglya (mgr.14180) 904 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 421 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 529 op/s 2024-02-19T22:19:54.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:52.710208+0000 mgr.smithi099.zfglya (mgr.14180) 904 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 421 MiB data, 7.5 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 529 op/s 2024-02-19T22:19:54.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 415830 46.34 MB/sec execute 359 sec latency 99.930 ms 2024-02-19T22:19:55.162 INFO:tasks.workunit.client.1.smithi138.stdout: 10 212261 22.81 MB/sec execute 363 sec latency 88.891 ms 2024-02-19T22:19:55.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 416633 46.34 MB/sec execute 360 sec latency 126.077 ms 2024-02-19T22:19:56.163 INFO:tasks.workunit.client.1.smithi138.stdout: 10 212635 22.82 MB/sec execute 364 sec latency 124.644 ms 2024-02-19T22:19:56.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:54.710708+0000 mgr.smithi099.zfglya (mgr.14180) 905 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 417 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 438 op/s 2024-02-19T22:19:56.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:54.710708+0000 mgr.smithi099.zfglya (mgr.14180) 905 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 417 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 438 op/s 2024-02-19T22:19:56.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 418068 46.42 MB/sec execute 361 sec latency 99.548 ms 2024-02-19T22:19:57.163 INFO:tasks.workunit.client.1.smithi138.stdout: 10 213023 22.83 MB/sec execute 365 sec latency 85.086 ms 2024-02-19T22:19:57.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 419262 46.47 MB/sec execute 362 sec latency 308.623 ms 2024-02-19T22:19:58.163 INFO:tasks.workunit.client.1.smithi138.stdout: 10 213341 22.80 MB/sec execute 366 sec latency 93.717 ms 2024-02-19T22:19:58.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:19:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:56.711191+0000 mgr.smithi099.zfglya (mgr.14180) 906 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 413 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.7 MiB/s wr, 422 op/s 2024-02-19T22:19:58.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:19:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:56.711191+0000 mgr.smithi099.zfglya (mgr.14180) 906 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 413 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.7 MiB/s wr, 422 op/s 2024-02-19T22:19:58.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 419387 46.36 MB/sec execute 363 sec latency 105.382 ms 2024-02-19T22:19:59.163 INFO:tasks.workunit.client.1.smithi138.stdout: 10 213646 22.78 MB/sec execute 367 sec latency 121.970 ms 2024-02-19T22:19:59.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 420322 46.36 MB/sec execute 364 sec latency 114.513 ms 2024-02-19T22:20:00.163 INFO:tasks.workunit.client.1.smithi138.stdout: 10 213952 22.77 MB/sec execute 368 sec latency 102.085 ms 2024-02-19T22:20:00.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:19:58.711679+0000 mgr.smithi099.zfglya (mgr.14180) 907 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 416 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 17 KiB/s rd, 9.4 MiB/s wr, 423 op/s 2024-02-19T22:20:00.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:00.000114+0000 mon.smithi099 (mon.0) 832 : cluster [INF] overall HEALTH_OK 2024-02-19T22:20:00.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:19:58.711679+0000 mgr.smithi099.zfglya (mgr.14180) 907 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 416 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 17 KiB/s rd, 9.4 MiB/s wr, 423 op/s 2024-02-19T22:20:00.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:00.000114+0000 mon.smithi099 (mon.0) 832 : cluster [INF] overall HEALTH_OK 2024-02-19T22:20:00.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 421559 46.43 MB/sec execute 365 sec latency 119.937 ms 2024-02-19T22:20:01.163 INFO:tasks.workunit.client.1.smithi138.stdout: 10 214286 22.76 MB/sec execute 369 sec latency 102.728 ms 2024-02-19T22:20:01.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 422856 46.49 MB/sec execute 366 sec latency 102.661 ms 2024-02-19T22:20:02.163 INFO:tasks.workunit.client.1.smithi138.stdout: 10 214650 22.72 MB/sec execute 370 sec latency 110.464 ms 2024-02-19T22:20:02.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:00.712269+0000 mgr.smithi099.zfglya (mgr.14180) 908 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 418 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 387 op/s 2024-02-19T22:20:02.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:00.712269+0000 mgr.smithi099.zfglya (mgr.14180) 908 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 418 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 387 op/s 2024-02-19T22:20:02.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 423045 46.38 MB/sec execute 367 sec latency 102.138 ms 2024-02-19T22:20:03.164 INFO:tasks.workunit.client.1.smithi138.stdout: 10 215033 22.69 MB/sec execute 371 sec latency 157.365 ms 2024-02-19T22:20:03.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 423948 46.38 MB/sec execute 368 sec latency 370.635 ms 2024-02-19T22:20:04.164 INFO:tasks.workunit.client.1.smithi138.stdout: 10 215467 22.71 MB/sec execute 372 sec latency 99.407 ms 2024-02-19T22:20:04.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:02.712771+0000 mgr.smithi099.zfglya (mgr.14180) 909 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 425 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 487 op/s 2024-02-19T22:20:04.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:02.712771+0000 mgr.smithi099.zfglya (mgr.14180) 909 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 425 MiB data, 7.4 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 487 op/s 2024-02-19T22:20:04.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 425223 46.46 MB/sec execute 369 sec latency 120.294 ms 2024-02-19T22:20:05.164 INFO:tasks.workunit.client.1.smithi138.stdout: 10 215983 22.73 MB/sec execute 373 sec latency 100.965 ms 2024-02-19T22:20:05.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 426398 46.51 MB/sec execute 370 sec latency 113.528 ms 2024-02-19T22:20:06.164 INFO:tasks.workunit.client.1.smithi138.stdout: 10 216347 22.73 MB/sec execute 374 sec latency 100.497 ms 2024-02-19T22:20:06.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:04.713325+0000 mgr.smithi099.zfglya (mgr.14180) 910 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 415 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 19 KiB/s rd, 8.0 MiB/s wr, 396 op/s 2024-02-19T22:20:06.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:04.713325+0000 mgr.smithi099.zfglya (mgr.14180) 910 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 415 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 19 KiB/s rd, 8.0 MiB/s wr, 396 op/s 2024-02-19T22:20:06.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 426577 46.39 MB/sec execute 371 sec latency 108.307 ms 2024-02-19T22:20:07.164 INFO:tasks.workunit.client.1.smithi138.stdout: 10 216830 22.76 MB/sec execute 375 sec latency 89.204 ms 2024-02-19T22:20:07.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 427897 46.42 MB/sec execute 372 sec latency 108.337 ms 2024-02-19T22:20:08.164 INFO:tasks.workunit.client.1.smithi138.stdout: 10 217184 22.75 MB/sec execute 376 sec latency 96.424 ms 2024-02-19T22:20:08.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:06.713865+0000 mgr.smithi099.zfglya (mgr.14180) 911 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 415 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 431 op/s 2024-02-19T22:20:08.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:06.713865+0000 mgr.smithi099.zfglya (mgr.14180) 911 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 415 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 431 op/s 2024-02-19T22:20:08.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 428942 46.50 MB/sec execute 373 sec latency 239.145 ms 2024-02-19T22:20:09.164 INFO:tasks.workunit.client.1.smithi138.stdout: 10 217463 22.72 MB/sec execute 377 sec latency 129.326 ms 2024-02-19T22:20:09.846 INFO:tasks.workunit.client.0.smithi099.stdout: 10 429959 46.52 MB/sec execute 374 sec latency 124.976 ms 2024-02-19T22:20:10.171 INFO:tasks.workunit.client.1.smithi138.stdout: 10 217746 22.71 MB/sec execute 378 sec latency 153.587 ms 2024-02-19T22:20:10.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:08.714341+0000 mgr.smithi099.zfglya (mgr.14180) 912 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 416 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 16 KiB/s rd, 10 MiB/s wr, 522 op/s 2024-02-19T22:20:10.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:08.714341+0000 mgr.smithi099.zfglya (mgr.14180) 912 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 416 MiB data, 7.6 GiB used, 708 GiB / 715 GiB avail; 16 KiB/s rd, 10 MiB/s wr, 522 op/s 2024-02-19T22:20:10.847 INFO:tasks.workunit.client.0.smithi099.stdout: 10 430132 46.41 MB/sec execute 375 sec latency 96.302 ms 2024-02-19T22:20:11.171 INFO:tasks.workunit.client.1.smithi138.stdout: 10 218141 22.68 MB/sec execute 379 sec latency 125.210 ms 2024-02-19T22:20:11.847 INFO:tasks.workunit.client.0.smithi099.stdout: 10 431493 46.44 MB/sec execute 376 sec latency 113.814 ms 2024-02-19T22:20:12.171 INFO:tasks.workunit.client.1.smithi138.stdout: 10 218603 22.67 MB/sec execute 380 sec latency 78.259 ms 2024-02-19T22:20:12.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:10.714922+0000 mgr.smithi099.zfglya (mgr.14180) 913 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 419 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 466 op/s 2024-02-19T22:20:12.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:10.714922+0000 mgr.smithi099.zfglya (mgr.14180) 913 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 419 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 466 op/s 2024-02-19T22:20:12.847 INFO:tasks.workunit.client.0.smithi099.stdout: 10 432544 46.52 MB/sec execute 377 sec latency 112.020 ms 2024-02-19T22:20:13.171 INFO:tasks.workunit.client.1.smithi138.stdout: 10 219037 22.67 MB/sec execute 381 sec latency 133.303 ms 2024-02-19T22:20:13.847 INFO:tasks.workunit.client.0.smithi099.stdout: 10 433537 46.54 MB/sec execute 378 sec latency 105.387 ms 2024-02-19T22:20:14.171 INFO:tasks.workunit.client.1.smithi138.stdout: 10 219552 22.70 MB/sec execute 382 sec latency 93.641 ms 2024-02-19T22:20:14.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:12.715473+0000 mgr.smithi099.zfglya (mgr.14180) 914 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 421 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 499 op/s 2024-02-19T22:20:14.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:12.715473+0000 mgr.smithi099.zfglya (mgr.14180) 914 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 421 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 499 op/s 2024-02-19T22:20:14.847 INFO:tasks.workunit.client.0.smithi099.stdout: 10 434165 46.51 MB/sec execute 379 sec latency 101.949 ms 2024-02-19T22:20:15.171 INFO:tasks.workunit.client.1.smithi138.stdout: 10 219969 22.72 MB/sec execute 383 sec latency 68.299 ms 2024-02-19T22:20:15.847 INFO:tasks.workunit.client.0.smithi099.stdout: 10 435662 46.60 MB/sec execute 380 sec latency 112.005 ms 2024-02-19T22:20:16.171 INFO:tasks.workunit.client.1.smithi138.stdout: 10 220379 22.73 MB/sec execute 384 sec latency 67.345 ms 2024-02-19T22:20:16.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:14.715883+0000 mgr.smithi099.zfglya (mgr.14180) 915 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 421 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 450 op/s 2024-02-19T22:20:16.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:14.715883+0000 mgr.smithi099.zfglya (mgr.14180) 915 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 421 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 450 op/s 2024-02-19T22:20:16.847 INFO:tasks.workunit.client.0.smithi099.stdout: 10 436996 46.67 MB/sec execute 381 sec latency 110.964 ms 2024-02-19T22:20:17.171 INFO:tasks.workunit.client.1.smithi138.stdout: 10 220674 22.71 MB/sec execute 385 sec latency 95.201 ms 2024-02-19T22:20:17.847 INFO:tasks.workunit.client.0.smithi099.stdout: 10 437122 46.55 MB/sec execute 382 sec latency 119.180 ms 2024-02-19T22:20:18.174 INFO:tasks.workunit.client.1.smithi138.stdout: 10 220950 22.68 MB/sec execute 386 sec latency 104.079 ms 2024-02-19T22:20:18.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:16.716338+0000 mgr.smithi099.zfglya (mgr.14180) 916 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 412 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 485 op/s 2024-02-19T22:20:18.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:16.716338+0000 mgr.smithi099.zfglya (mgr.14180) 916 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 412 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 485 op/s 2024-02-19T22:20:18.847 INFO:tasks.workunit.client.0.smithi099.stdout: 10 438129 46.56 MB/sec execute 383 sec latency 166.304 ms 2024-02-19T22:20:19.173 INFO:tasks.workunit.client.1.smithi138.stdout: 10 221287 22.66 MB/sec execute 387 sec latency 94.372 ms 2024-02-19T22:20:19.847 INFO:tasks.workunit.client.0.smithi099.stdout: 10 438388 46.45 MB/sec execute 384 sec latency 511.304 ms 2024-02-19T22:20:20.173 INFO:tasks.workunit.client.1.smithi138.stdout: 10 221623 22.65 MB/sec execute 388 sec latency 137.431 ms 2024-02-19T22:20:20.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:18.716893+0000 mgr.smithi099.zfglya (mgr.14180) 917 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 420 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 17 KiB/s rd, 10 MiB/s wr, 483 op/s 2024-02-19T22:20:20.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:18.716893+0000 mgr.smithi099.zfglya (mgr.14180) 917 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 420 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 17 KiB/s rd, 10 MiB/s wr, 483 op/s 2024-02-19T22:20:20.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 438700 46.36 MB/sec execute 385 sec latency 498.405 ms 2024-02-19T22:20:21.173 INFO:tasks.workunit.client.1.smithi138.stdout: 10 221985 22.62 MB/sec execute 389 sec latency 88.691 ms 2024-02-19T22:20:21.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 438888 46.29 MB/sec execute 386 sec latency 744.715 ms 2024-02-19T22:20:22.173 INFO:tasks.workunit.client.1.smithi138.stdout: 10 222441 22.62 MB/sec execute 390 sec latency 77.989 ms 2024-02-19T22:20:22.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:20.717466+0000 mgr.smithi099.zfglya (mgr.14180) 918 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 419 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 13 KiB/s rd, 9.9 MiB/s wr, 409 op/s 2024-02-19T22:20:22.546 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:20.717466+0000 mgr.smithi099.zfglya (mgr.14180) 918 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 419 MiB data, 7.7 GiB used, 708 GiB / 715 GiB avail; 13 KiB/s rd, 9.9 MiB/s wr, 409 op/s 2024-02-19T22:20:22.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 440267 46.40 MB/sec execute 387 sec latency 388.277 ms 2024-02-19T22:20:23.176 INFO:tasks.workunit.client.1.smithi138.stdout: 10 222962 22.64 MB/sec execute 391 sec latency 76.683 ms 2024-02-19T22:20:23.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 440659 46.32 MB/sec execute 388 sec latency 88.872 ms 2024-02-19T22:20:24.176 INFO:tasks.workunit.client.1.smithi138.stdout: 10 223388 22.66 MB/sec execute 392 sec latency 96.451 ms 2024-02-19T22:20:24.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:22.718030+0000 mgr.smithi099.zfglya (mgr.14180) 919 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 415 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 9.0 MiB/s wr, 462 op/s 2024-02-19T22:20:24.547 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:22.718030+0000 mgr.smithi099.zfglya (mgr.14180) 919 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 415 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 9.0 MiB/s wr, 462 op/s 2024-02-19T22:20:24.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 441464 46.33 MB/sec execute 389 sec latency 112.897 ms 2024-02-19T22:20:25.176 INFO:tasks.workunit.client.1.smithi138.stdout: 10 223800 22.67 MB/sec execute 393 sec latency 125.214 ms 2024-02-19T22:20:25.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 442640 46.36 MB/sec execute 390 sec latency 151.851 ms 2024-02-19T22:20:26.176 INFO:tasks.workunit.client.1.smithi138.stdout: 10 224190 22.66 MB/sec execute 394 sec latency 23.919 ms 2024-02-19T22:20:26.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:24.718448+0000 mgr.smithi099.zfglya (mgr.14180) 920 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 413 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 470 op/s 2024-02-19T22:20:26.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:24.718448+0000 mgr.smithi099.zfglya (mgr.14180) 920 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 413 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 470 op/s 2024-02-19T22:20:26.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 444086 46.45 MB/sec execute 391 sec latency 129.409 ms 2024-02-19T22:20:27.176 INFO:tasks.workunit.client.1.smithi138.stdout: 10 224564 22.66 MB/sec execute 395 sec latency 93.808 ms 2024-02-19T22:20:27.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 444208 46.34 MB/sec execute 392 sec latency 164.017 ms 2024-02-19T22:20:28.176 INFO:tasks.workunit.client.1.smithi138.stdout: 10 224832 22.62 MB/sec execute 396 sec latency 100.313 ms 2024-02-19T22:20:28.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:26.718931+0000 mgr.smithi099.zfglya (mgr.14180) 921 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 414 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 430 op/s 2024-02-19T22:20:28.545 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:26.718931+0000 mgr.smithi099.zfglya (mgr.14180) 921 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 414 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 430 op/s 2024-02-19T22:20:28.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 445143 46.34 MB/sec execute 393 sec latency 93.452 ms 2024-02-19T22:20:29.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 225141 22.61 MB/sec execute 397 sec latency 105.373 ms 2024-02-19T22:20:29.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 446474 46.42 MB/sec execute 394 sec latency 104.588 ms 2024-02-19T22:20:30.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 225416 22.57 MB/sec execute 398 sec latency 109.848 ms 2024-02-19T22:20:30.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:28.719491+0000 mgr.smithi099.zfglya (mgr.14180) 922 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 420 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 9.9 MiB/s wr, 481 op/s 2024-02-19T22:20:30.545 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:28.719491+0000 mgr.smithi099.zfglya (mgr.14180) 922 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 420 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 9.9 MiB/s wr, 481 op/s 2024-02-19T22:20:30.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 447633 46.46 MB/sec execute 395 sec latency 135.778 ms 2024-02-19T22:20:31.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 225833 22.57 MB/sec execute 399 sec latency 118.143 ms 2024-02-19T22:20:31.851 INFO:tasks.workunit.client.0.smithi099.stdout: 10 447785 46.36 MB/sec execute 396 sec latency 96.591 ms 2024-02-19T22:20:32.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 226239 22.57 MB/sec execute 400 sec latency 84.643 ms 2024-02-19T22:20:32.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:30.719942+0000 mgr.smithi099.zfglya (mgr.14180) 923 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 415 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 473 op/s 2024-02-19T22:20:32.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:30.719942+0000 mgr.smithi099.zfglya (mgr.14180) 923 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 415 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 473 op/s 2024-02-19T22:20:32.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 448345 46.32 MB/sec execute 397 sec latency 350.755 ms 2024-02-19T22:20:33.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 226721 22.60 MB/sec execute 401 sec latency 116.913 ms 2024-02-19T22:20:33.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:20:32.472504+0000 mon.smithi099 (mon.0) 833 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:20:33.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:20:32.971076+0000 mon.smithi099 (mon.0) 834 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:20:33.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:20:32.972260+0000 mon.smithi099 (mon.0) 835 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:20:33.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:20:32.982227+0000 mon.smithi099 (mon.0) 836 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:20:33.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:20:32.472504+0000 mon.smithi099 (mon.0) 833 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:20:33.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:20:32.971076+0000 mon.smithi099 (mon.0) 834 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:20:33.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:20:32.972260+0000 mon.smithi099 (mon.0) 835 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:20:33.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:20:32.982227+0000 mon.smithi099 (mon.0) 836 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:20:33.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 449687 46.38 MB/sec execute 398 sec latency 135.706 ms 2024-02-19T22:20:34.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 227102 22.61 MB/sec execute 402 sec latency 82.733 ms 2024-02-19T22:20:34.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:32.720476+0000 mgr.smithi099.zfglya (mgr.14180) 924 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 412 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 9.2 MiB/s wr, 510 op/s 2024-02-19T22:20:34.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:32.720476+0000 mgr.smithi099.zfglya (mgr.14180) 924 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 412 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 9.2 MiB/s wr, 510 op/s 2024-02-19T22:20:34.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 451175 46.48 MB/sec execute 399 sec latency 103.468 ms 2024-02-19T22:20:35.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 227530 22.60 MB/sec execute 403 sec latency 66.584 ms 2024-02-19T22:20:35.850 INFO:tasks.workunit.client.0.smithi099.stdout: 10 451300 46.37 MB/sec execute 400 sec latency 98.823 ms 2024-02-19T22:20:36.179 INFO:tasks.workunit.client.1.smithi138.stdout: 10 227888 22.60 MB/sec execute 404 sec latency 86.620 ms 2024-02-19T22:20:36.454 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:34.721020+0000 mgr.smithi099.zfglya (mgr.14180) 925 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 414 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 8.6 MiB/s wr, 458 op/s 2024-02-19T22:20:36.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:34.721020+0000 mgr.smithi099.zfglya (mgr.14180) 925 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 414 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 8.6 MiB/s wr, 458 op/s 2024-02-19T22:20:36.851 INFO:tasks.workunit.client.0.smithi099.stdout: 10 452259 46.37 MB/sec execute 401 sec latency 119.176 ms 2024-02-19T22:20:37.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 228193 22.58 MB/sec execute 405 sec latency 133.773 ms 2024-02-19T22:20:37.851 INFO:tasks.workunit.client.0.smithi099.stdout: 10 453463 46.44 MB/sec execute 402 sec latency 210.175 ms 2024-02-19T22:20:38.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 228549 22.56 MB/sec execute 406 sec latency 162.609 ms 2024-02-19T22:20:38.453 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:36.721504+0000 mgr.smithi099.zfglya (mgr.14180) 926 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 422 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 419 op/s 2024-02-19T22:20:38.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:36.721504+0000 mgr.smithi099.zfglya (mgr.14180) 926 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 422 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 419 op/s 2024-02-19T22:20:38.851 INFO:tasks.workunit.client.0.smithi099.stdout: 10 454718 46.49 MB/sec execute 403 sec latency 354.203 ms 2024-02-19T22:20:39.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 228920 22.54 MB/sec execute 407 sec latency 104.715 ms 2024-02-19T22:20:39.851 INFO:tasks.workunit.client.0.smithi099.stdout: 10 454845 46.38 MB/sec execute 404 sec latency 91.853 ms 2024-02-19T22:20:40.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 229344 22.53 MB/sec execute 408 sec latency 100.827 ms 2024-02-19T22:20:40.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:38.721924+0000 mgr.smithi099.zfglya (mgr.14180) 927 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 424 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 450 op/s 2024-02-19T22:20:40.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:38.721924+0000 mgr.smithi099.zfglya (mgr.14180) 927 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 424 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 450 op/s 2024-02-19T22:20:40.851 INFO:tasks.workunit.client.0.smithi099.stdout: 10 455857 46.39 MB/sec execute 405 sec latency 104.412 ms 2024-02-19T22:20:41.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 229823 22.55 MB/sec execute 409 sec latency 106.663 ms 2024-02-19T22:20:41.851 INFO:tasks.workunit.client.0.smithi099.stdout: 10 457212 46.48 MB/sec execute 406 sec latency 133.404 ms 2024-02-19T22:20:42.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 230364 22.58 MB/sec execute 410 sec latency 80.978 ms 2024-02-19T22:20:42.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:40.722418+0000 mgr.smithi099.zfglya (mgr.14180) 928 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 417 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 424 op/s 2024-02-19T22:20:42.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:40.722418+0000 mgr.smithi099.zfglya (mgr.14180) 928 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 417 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 424 op/s 2024-02-19T22:20:42.851 INFO:tasks.workunit.client.0.smithi099.stdout: 10 458807 46.88 MB/sec execute 407 sec latency 107.820 ms 2024-02-19T22:20:43.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 230805 22.60 MB/sec execute 411 sec latency 96.611 ms 2024-02-19T22:20:43.851 INFO:tasks.workunit.client.0.smithi099.stdout: 10 459135 46.92 MB/sec execute 408 sec latency 92.991 ms 2024-02-19T22:20:44.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 231186 22.58 MB/sec execute 412 sec latency 109.828 ms 2024-02-19T22:20:44.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:42.723006+0000 mgr.smithi099.zfglya (mgr.14180) 929 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 419 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 465 op/s 2024-02-19T22:20:44.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:42.723006+0000 mgr.smithi099.zfglya (mgr.14180) 929 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 419 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 465 op/s 2024-02-19T22:20:44.853 INFO:tasks.workunit.client.0.smithi099.stdout: 10 459946 46.92 MB/sec execute 409 sec latency 99.947 ms 2024-02-19T22:20:45.178 INFO:tasks.workunit.client.1.smithi138.stdout: 10 231557 22.59 MB/sec execute 413 sec latency 103.819 ms 2024-02-19T22:20:45.853 INFO:tasks.workunit.client.0.smithi099.stdout: 10 461417 46.99 MB/sec execute 410 sec latency 107.034 ms 2024-02-19T22:20:46.179 INFO:tasks.workunit.client.1.smithi138.stdout: 10 231860 22.56 MB/sec execute 414 sec latency 100.565 ms 2024-02-19T22:20:46.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:44.723524+0000 mgr.smithi099.zfglya (mgr.14180) 930 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 421 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 9.6 MiB/s wr, 472 op/s 2024-02-19T22:20:46.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:44.723524+0000 mgr.smithi099.zfglya (mgr.14180) 930 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 421 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 9.6 MiB/s wr, 472 op/s 2024-02-19T22:20:46.853 INFO:tasks.workunit.client.0.smithi099.stdout: 10 462623 47.03 MB/sec execute 411 sec latency 117.765 ms 2024-02-19T22:20:47.181 INFO:tasks.workunit.client.1.smithi138.stdout: 10 232264 22.56 MB/sec execute 415 sec latency 104.867 ms 2024-02-19T22:20:47.853 INFO:tasks.workunit.client.0.smithi099.stdout: 10 462803 46.93 MB/sec execute 412 sec latency 79.956 ms 2024-02-19T22:20:48.181 INFO:tasks.workunit.client.1.smithi138.stdout: 10 232649 22.54 MB/sec execute 416 sec latency 96.674 ms 2024-02-19T22:20:48.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:46.724013+0000 mgr.smithi099.zfglya (mgr.14180) 931 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 428 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 473 op/s 2024-02-19T22:20:48.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:46.724013+0000 mgr.smithi099.zfglya (mgr.14180) 931 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 428 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 473 op/s 2024-02-19T22:20:48.853 INFO:tasks.workunit.client.0.smithi099.stdout: 10 464286 46.97 MB/sec execute 413 sec latency 102.102 ms 2024-02-19T22:20:49.184 INFO:tasks.workunit.client.1.smithi138.stdout: 10 233052 22.53 MB/sec execute 417 sec latency 90.969 ms 2024-02-19T22:20:49.853 INFO:tasks.workunit.client.0.smithi099.stdout: 10 465588 47.08 MB/sec execute 414 sec latency 124.116 ms 2024-02-19T22:20:50.184 INFO:tasks.workunit.client.1.smithi138.stdout: 10 233420 22.53 MB/sec execute 418 sec latency 113.194 ms 2024-02-19T22:20:50.545 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:48.724508+0000 mgr.smithi099.zfglya (mgr.14180) 932 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 425 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 9.9 MiB/s wr, 493 op/s 2024-02-19T22:20:50.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:48.724508+0000 mgr.smithi099.zfglya (mgr.14180) 932 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 425 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 9.9 MiB/s wr, 493 op/s 2024-02-19T22:20:50.853 INFO:tasks.workunit.client.0.smithi099.stdout: 10 466230 47.04 MB/sec execute 415 sec latency 93.049 ms 2024-02-19T22:20:51.184 INFO:tasks.workunit.client.1.smithi138.stdout: 10 233924 22.55 MB/sec execute 419 sec latency 100.851 ms 2024-02-19T22:20:51.853 INFO:tasks.workunit.client.0.smithi099.stdout: 10 466969 47.03 MB/sec execute 416 sec latency 96.972 ms 2024-02-19T22:20:52.184 INFO:tasks.workunit.client.1.smithi138.stdout: 10 234315 22.56 MB/sec execute 420 sec latency 78.445 ms 2024-02-19T22:20:52.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:50.724967+0000 mgr.smithi099.zfglya (mgr.14180) 933 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 420 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 522 op/s 2024-02-19T22:20:52.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:50.724967+0000 mgr.smithi099.zfglya (mgr.14180) 933 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 420 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 522 op/s 2024-02-19T22:20:52.853 INFO:tasks.workunit.client.0.smithi099.stdout: 10 468343 47.10 MB/sec execute 417 sec latency 154.597 ms 2024-02-19T22:20:53.184 INFO:tasks.workunit.client.1.smithi138.stdout: 10 234744 22.57 MB/sec execute 421 sec latency 111.838 ms 2024-02-19T22:20:53.853 INFO:tasks.workunit.client.0.smithi099.stdout: 10 469403 47.12 MB/sec execute 418 sec latency 346.271 ms 2024-02-19T22:20:54.184 INFO:tasks.workunit.client.1.smithi138.stdout: 10 235090 22.56 MB/sec execute 422 sec latency 119.375 ms 2024-02-19T22:20:54.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:52.725454+0000 mgr.smithi099.zfglya (mgr.14180) 934 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 424 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 525 op/s 2024-02-19T22:20:54.703 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:52.725454+0000 mgr.smithi099.zfglya (mgr.14180) 934 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 424 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 525 op/s 2024-02-19T22:20:54.857 INFO:tasks.workunit.client.0.smithi099.stdout: 10 469672 47.05 MB/sec execute 419 sec latency 794.712 ms 2024-02-19T22:20:55.184 INFO:tasks.workunit.client.1.smithi138.stdout: 10 235421 22.54 MB/sec execute 423 sec latency 99.595 ms 2024-02-19T22:20:55.857 INFO:tasks.workunit.client.0.smithi099.stdout: 10 469676 46.93 MB/sec execute 420 sec latency 780.707 ms 2024-02-19T22:20:56.185 INFO:tasks.workunit.client.1.smithi138.stdout: 10 235806 22.53 MB/sec execute 424 sec latency 128.682 ms 2024-02-19T22:20:56.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:54.725939+0000 mgr.smithi099.zfglya (mgr.14180) 935 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 425 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 9.6 MiB/s wr, 499 op/s 2024-02-19T22:20:56.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:54.725939+0000 mgr.smithi099.zfglya (mgr.14180) 935 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 425 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 9.6 MiB/s wr, 499 op/s 2024-02-19T22:20:56.857 INFO:tasks.workunit.client.0.smithi099.stdout: 10 469697 46.82 MB/sec execute 421 sec latency 492.633 ms 2024-02-19T22:20:57.185 INFO:tasks.workunit.client.1.smithi138.stdout: 10 236115 22.51 MB/sec execute 425 sec latency 86.354 ms 2024-02-19T22:20:57.857 INFO:tasks.workunit.client.0.smithi099.stdout: 10 469782 46.72 MB/sec execute 422 sec latency 511.324 ms 2024-02-19T22:20:58.185 INFO:tasks.workunit.client.1.smithi138.stdout: 10 236460 22.48 MB/sec execute 426 sec latency 129.451 ms 2024-02-19T22:20:58.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:20:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:56.726444+0000 mgr.smithi099.zfglya (mgr.14180) 936 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 426 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 427 op/s 2024-02-19T22:20:58.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:20:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:56.726444+0000 mgr.smithi099.zfglya (mgr.14180) 936 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 426 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 427 op/s 2024-02-19T22:20:58.857 INFO:tasks.workunit.client.0.smithi099.stdout: 10 470733 46.72 MB/sec execute 423 sec latency 98.494 ms 2024-02-19T22:20:59.185 INFO:tasks.workunit.client.1.smithi138.stdout: 10 236806 22.48 MB/sec execute 427 sec latency 74.520 ms 2024-02-19T22:20:59.857 INFO:tasks.workunit.client.0.smithi099.stdout: 10 472067 46.79 MB/sec execute 424 sec latency 111.409 ms 2024-02-19T22:21:00.185 INFO:tasks.workunit.client.1.smithi138.stdout: 10 237279 22.50 MB/sec execute 428 sec latency 70.905 ms 2024-02-19T22:21:00.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:20:58.726901+0000 mgr.smithi099.zfglya (mgr.14180) 937 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 423 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 20 KiB/s rd, 9.6 MiB/s wr, 485 op/s 2024-02-19T22:21:00.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:20:58.726901+0000 mgr.smithi099.zfglya (mgr.14180) 937 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 423 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 20 KiB/s rd, 9.6 MiB/s wr, 485 op/s 2024-02-19T22:21:00.857 INFO:tasks.workunit.client.0.smithi099.stdout: 10 473249 46.83 MB/sec execute 425 sec latency 128.056 ms 2024-02-19T22:21:01.185 INFO:tasks.workunit.client.1.smithi138.stdout: 10 237635 22.48 MB/sec execute 429 sec latency 103.202 ms 2024-02-19T22:21:01.857 INFO:tasks.workunit.client.0.smithi099.stdout: 10 473439 46.73 MB/sec execute 426 sec latency 88.219 ms 2024-02-19T22:21:02.185 INFO:tasks.workunit.client.1.smithi138.stdout: 10 238041 22.51 MB/sec execute 430 sec latency 86.801 ms 2024-02-19T22:21:02.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:00.727449+0000 mgr.smithi099.zfglya (mgr.14180) 938 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 420 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 475 op/s 2024-02-19T22:21:02.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:00.727449+0000 mgr.smithi099.zfglya (mgr.14180) 938 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 420 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 475 op/s 2024-02-19T22:21:02.857 INFO:tasks.workunit.client.0.smithi099.stdout: 10 474711 46.75 MB/sec execute 427 sec latency 147.143 ms 2024-02-19T22:21:03.185 INFO:tasks.workunit.client.1.smithi138.stdout: 10 238547 22.53 MB/sec execute 431 sec latency 125.310 ms 2024-02-19T22:21:03.857 INFO:tasks.workunit.client.0.smithi099.stdout: 10 475859 46.84 MB/sec execute 428 sec latency 157.119 ms 2024-02-19T22:21:04.186 INFO:tasks.workunit.client.1.smithi138.stdout: 10 238891 22.50 MB/sec execute 432 sec latency 139.854 ms 2024-02-19T22:21:04.548 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:02.727959+0000 mgr.smithi099.zfglya (mgr.14180) 939 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 426 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 9.8 MiB/s wr, 473 op/s 2024-02-19T22:21:04.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:02.727959+0000 mgr.smithi099.zfglya (mgr.14180) 939 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 426 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 9.8 MiB/s wr, 473 op/s 2024-02-19T22:21:04.857 INFO:tasks.workunit.client.0.smithi099.stdout: 10 476830 46.84 MB/sec execute 429 sec latency 92.088 ms 2024-02-19T22:21:05.187 INFO:tasks.workunit.client.1.smithi138.stdout: 10 239235 22.48 MB/sec execute 433 sec latency 109.136 ms 2024-02-19T22:21:05.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 477277 46.79 MB/sec execute 430 sec latency 108.773 ms 2024-02-19T22:21:06.187 INFO:tasks.workunit.client.1.smithi138.stdout: 10 239545 22.46 MB/sec execute 434 sec latency 114.302 ms 2024-02-19T22:21:06.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:06 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:04.728493+0000 mgr.smithi099.zfglya (mgr.14180) 940 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 428 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 9.0 MiB/s wr, 456 op/s 2024-02-19T22:21:06.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:04.728493+0000 mgr.smithi099.zfglya (mgr.14180) 940 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 428 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 9.0 MiB/s wr, 456 op/s 2024-02-19T22:21:06.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 478737 46.83 MB/sec execute 431 sec latency 104.829 ms 2024-02-19T22:21:07.187 INFO:tasks.workunit.client.1.smithi138.stdout: 10 240022 22.46 MB/sec execute 435 sec latency 107.750 ms 2024-02-19T22:21:07.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 480346 46.96 MB/sec execute 432 sec latency 151.453 ms 2024-02-19T22:21:08.187 INFO:tasks.workunit.client.1.smithi138.stdout: 10 240390 22.46 MB/sec execute 436 sec latency 103.984 ms 2024-02-19T22:21:08.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:08 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:06.728984+0000 mgr.smithi099.zfglya (mgr.14180) 941 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 429 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 440 op/s 2024-02-19T22:21:08.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:08 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:06.728984+0000 mgr.smithi099.zfglya (mgr.14180) 941 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 429 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 440 op/s 2024-02-19T22:21:08.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 480471 46.86 MB/sec execute 433 sec latency 111.877 ms 2024-02-19T22:21:09.188 INFO:tasks.workunit.client.1.smithi138.stdout: 10 240953 22.49 MB/sec execute 437 sec latency 92.283 ms 2024-02-19T22:21:09.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 481261 46.86 MB/sec execute 434 sec latency 109.716 ms 2024-02-19T22:21:10.188 INFO:tasks.workunit.client.1.smithi138.stdout: 10 241294 22.48 MB/sec execute 438 sec latency 92.570 ms 2024-02-19T22:21:10.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:10 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:08.729431+0000 mgr.smithi099.zfglya (mgr.14180) 942 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 419 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 9.4 MiB/s wr, 475 op/s 2024-02-19T22:21:10.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:10 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:08.729431+0000 mgr.smithi099.zfglya (mgr.14180) 942 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 419 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 9.4 MiB/s wr, 475 op/s 2024-02-19T22:21:10.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 482588 46.91 MB/sec execute 435 sec latency 108.152 ms 2024-02-19T22:21:11.189 INFO:tasks.workunit.client.1.smithi138.stdout: 10 241716 22.49 MB/sec execute 439 sec latency 123.250 ms 2024-02-19T22:21:11.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 483902 46.97 MB/sec execute 436 sec latency 127.775 ms 2024-02-19T22:21:12.190 INFO:tasks.workunit.client.1.smithi138.stdout: 10 242106 22.50 MB/sec execute 440 sec latency 126.885 ms 2024-02-19T22:21:12.546 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:12 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:10.729877+0000 mgr.smithi099.zfglya (mgr.14180) 943 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 426 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 11 KiB/s rd, 10 MiB/s wr, 476 op/s 2024-02-19T22:21:12.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:12 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:10.729877+0000 mgr.smithi099.zfglya (mgr.14180) 943 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 426 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 11 KiB/s rd, 10 MiB/s wr, 476 op/s 2024-02-19T22:21:12.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 484026 46.87 MB/sec execute 437 sec latency 101.455 ms 2024-02-19T22:21:13.191 INFO:tasks.workunit.client.1.smithi138.stdout: 10 242469 22.48 MB/sec execute 441 sec latency 123.884 ms 2024-02-19T22:21:13.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 484122 46.77 MB/sec execute 438 sec latency 416.509 ms 2024-02-19T22:21:14.191 INFO:tasks.workunit.client.1.smithi138.stdout: 10 242807 22.47 MB/sec execute 442 sec latency 120.710 ms 2024-02-19T22:21:14.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:14 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:12.730387+0000 mgr.smithi099.zfglya (mgr.14180) 944 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 421 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 10 MiB/s wr, 498 op/s 2024-02-19T22:21:14.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:12.730387+0000 mgr.smithi099.zfglya (mgr.14180) 944 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 421 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 10 MiB/s wr, 498 op/s 2024-02-19T22:21:14.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 484175 46.66 MB/sec execute 439 sec latency 573.783 ms 2024-02-19T22:21:15.191 INFO:tasks.workunit.client.1.smithi138.stdout: 10 243071 22.44 MB/sec execute 443 sec latency 94.756 ms 2024-02-19T22:21:15.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 484458 46.60 MB/sec execute 440 sec latency 578.407 ms 2024-02-19T22:21:16.191 INFO:tasks.workunit.client.1.smithi138.stdout: 10 243463 22.42 MB/sec execute 444 sec latency 112.949 ms 2024-02-19T22:21:16.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:16 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:14.730891+0000 mgr.smithi099.zfglya (mgr.14180) 945 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 423 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 9.3 MiB/s wr, 452 op/s 2024-02-19T22:21:16.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:16 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:14.730891+0000 mgr.smithi099.zfglya (mgr.14180) 945 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 423 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 9.3 MiB/s wr, 452 op/s 2024-02-19T22:21:16.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 485648 46.60 MB/sec execute 441 sec latency 378.512 ms 2024-02-19T22:21:17.190 INFO:tasks.workunit.client.1.smithi138.stdout: 10 243888 22.42 MB/sec execute 445 sec latency 76.389 ms 2024-02-19T22:21:17.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 487172 46.73 MB/sec execute 442 sec latency 107.126 ms 2024-02-19T22:21:18.191 INFO:tasks.workunit.client.1.smithi138.stdout: 10 244461 22.46 MB/sec execute 446 sec latency 56.761 ms 2024-02-19T22:21:18.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:18 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:16.731488+0000 mgr.smithi099.zfglya (mgr.14180) 946 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 417 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 476 op/s 2024-02-19T22:21:18.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:18 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:16.731488+0000 mgr.smithi099.zfglya (mgr.14180) 946 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 417 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 476 op/s 2024-02-19T22:21:18.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 487563 46.66 MB/sec execute 443 sec latency 102.923 ms 2024-02-19T22:21:19.191 INFO:tasks.workunit.client.1.smithi138.stdout: 10 244863 22.46 MB/sec execute 447 sec latency 106.253 ms 2024-02-19T22:21:19.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 488354 46.66 MB/sec execute 444 sec latency 105.222 ms 2024-02-19T22:21:20.191 INFO:tasks.workunit.client.1.smithi138.stdout: 10 245284 22.47 MB/sec execute 448 sec latency 89.851 ms 2024-02-19T22:21:20.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:20 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:18.732079+0000 mgr.smithi099.zfglya (mgr.14180) 947 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 416 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 465 op/s 2024-02-19T22:21:20.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:20 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:18.732079+0000 mgr.smithi099.zfglya (mgr.14180) 947 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 416 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 465 op/s 2024-02-19T22:21:20.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 489679 46.72 MB/sec execute 445 sec latency 117.128 ms 2024-02-19T22:21:21.191 INFO:tasks.workunit.client.1.smithi138.stdout: 10 245663 22.48 MB/sec execute 449 sec latency 126.556 ms 2024-02-19T22:21:21.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 490994 46.77 MB/sec execute 446 sec latency 111.565 ms 2024-02-19T22:21:22.191 INFO:tasks.workunit.client.1.smithi138.stdout: 10 246010 22.45 MB/sec execute 450 sec latency 127.412 ms 2024-02-19T22:21:22.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:22 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:20.732568+0000 mgr.smithi099.zfglya (mgr.14180) 948 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 422 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 11 KiB/s rd, 11 MiB/s wr, 483 op/s 2024-02-19T22:21:22.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:22 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:20.732568+0000 mgr.smithi099.zfglya (mgr.14180) 948 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 422 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 11 KiB/s rd, 11 MiB/s wr, 483 op/s 2024-02-19T22:21:22.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 491116 46.67 MB/sec execute 447 sec latency 161.162 ms 2024-02-19T22:21:23.195 INFO:tasks.workunit.client.1.smithi138.stdout: 10 246415 22.45 MB/sec execute 451 sec latency 94.671 ms 2024-02-19T22:21:23.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 492149 46.68 MB/sec execute 448 sec latency 106.678 ms 2024-02-19T22:21:24.195 INFO:tasks.workunit.client.1.smithi138.stdout: 10 246748 22.42 MB/sec execute 452 sec latency 127.572 ms 2024-02-19T22:21:24.545 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:24 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:22.733002+0000 mgr.smithi099.zfglya (mgr.14180) 949 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 427 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 10 MiB/s wr, 461 op/s 2024-02-19T22:21:24.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:24 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:22.733002+0000 mgr.smithi099.zfglya (mgr.14180) 949 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 427 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 10 MiB/s wr, 461 op/s 2024-02-19T22:21:24.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 493513 46.76 MB/sec execute 449 sec latency 117.137 ms 2024-02-19T22:21:25.195 INFO:tasks.workunit.client.1.smithi138.stdout: 10 247208 22.43 MB/sec execute 453 sec latency 119.044 ms 2024-02-19T22:21:25.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 494587 46.78 MB/sec execute 450 sec latency 118.676 ms 2024-02-19T22:21:26.195 INFO:tasks.workunit.client.1.smithi138.stdout: 10 247558 22.42 MB/sec execute 454 sec latency 132.272 ms 2024-02-19T22:21:26.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:26 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:24.735668+0000 mgr.smithi099.zfglya (mgr.14180) 950 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 424 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 11 KiB/s rd, 9.4 MiB/s wr, 471 op/s 2024-02-19T22:21:26.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:26 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:24.735668+0000 mgr.smithi099.zfglya (mgr.14180) 950 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 424 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 11 KiB/s rd, 9.4 MiB/s wr, 471 op/s 2024-02-19T22:21:26.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 494658 46.68 MB/sec execute 451 sec latency 333.911 ms 2024-02-19T22:21:27.195 INFO:tasks.workunit.client.1.smithi138.stdout: 10 248086 22.44 MB/sec execute 455 sec latency 86.843 ms 2024-02-19T22:21:27.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 495667 46.69 MB/sec execute 452 sec latency 192.055 ms 2024-02-19T22:21:28.199 INFO:tasks.workunit.client.1.smithi138.stdout: 10 248468 22.44 MB/sec execute 456 sec latency 99.297 ms 2024-02-19T22:21:28.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:28 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:26.736142+0000 mgr.smithi099.zfglya (mgr.14180) 951 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 412 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 11 KiB/s rd, 10 MiB/s wr, 454 op/s 2024-02-19T22:21:28.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:28 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:26.736142+0000 mgr.smithi099.zfglya (mgr.14180) 951 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 412 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 11 KiB/s rd, 10 MiB/s wr, 454 op/s 2024-02-19T22:21:28.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 497025 46.76 MB/sec execute 453 sec latency 108.762 ms 2024-02-19T22:21:29.199 INFO:tasks.workunit.client.1.smithi138.stdout: 10 248902 22.46 MB/sec execute 457 sec latency 115.223 ms 2024-02-19T22:21:29.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 498119 46.79 MB/sec execute 454 sec latency 122.729 ms 2024-02-19T22:21:30.199 INFO:tasks.workunit.client.1.smithi138.stdout: 10 249232 22.45 MB/sec execute 458 sec latency 133.603 ms 2024-02-19T22:21:30.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:30 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:28.736670+0000 mgr.smithi099.zfglya (mgr.14180) 952 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 412 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 9.5 MiB/s wr, 458 op/s 2024-02-19T22:21:30.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:30 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:28.736670+0000 mgr.smithi099.zfglya (mgr.14180) 952 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 412 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 9.5 MiB/s wr, 458 op/s 2024-02-19T22:21:30.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 498303 46.70 MB/sec execute 455 sec latency 86.838 ms 2024-02-19T22:21:31.199 INFO:tasks.workunit.client.1.smithi138.stdout: 10 249557 22.43 MB/sec execute 459 sec latency 155.163 ms 2024-02-19T22:21:31.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 499785 46.73 MB/sec execute 456 sec latency 107.534 ms 2024-02-19T22:21:32.199 INFO:tasks.workunit.client.1.smithi138.stdout: 10 249951 22.43 MB/sec execute 460 sec latency 84.012 ms 2024-02-19T22:21:32.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:32 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:30.737274+0000 mgr.smithi099.zfglya (mgr.14180) 953 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 416 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 469 op/s 2024-02-19T22:21:32.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:32 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:30.737274+0000 mgr.smithi099.zfglya (mgr.14180) 953 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 416 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 469 op/s 2024-02-19T22:21:32.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 499976 46.67 MB/sec execute 457 sec latency 584.411 ms 2024-02-19T22:21:33.199 INFO:tasks.workunit.client.1.smithi138.stdout: 10 250207 22.39 MB/sec execute 461 sec latency 154.948 ms 2024-02-19T22:21:33.702 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:21:32.989890+0000 mon.smithi099 (mon.0) 837 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:21:33.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:21:32.989890+0000 mon.smithi099 (mon.0) 837 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:21:33.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 500298 46.64 MB/sec execute 458 sec latency 575.040 ms 2024-02-19T22:21:34.201 INFO:tasks.workunit.client.1.smithi138.stdout: 10 250659 22.38 MB/sec execute 462 sec latency 117.990 ms 2024-02-19T22:21:34.704 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:32.737859+0000 mgr.smithi099.zfglya (mgr.14180) 954 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 426 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 10 MiB/s wr, 510 op/s 2024-02-19T22:21:34.704 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:21:33.505516+0000 mon.smithi099 (mon.0) 838 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:21:34.704 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:21:33.506971+0000 mon.smithi099 (mon.0) 839 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:21:34.704 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:21:33.515020+0000 mon.smithi099 (mon.0) 840 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:21:34.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:32.737859+0000 mgr.smithi099.zfglya (mgr.14180) 954 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 426 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 10 MiB/s wr, 510 op/s 2024-02-19T22:21:34.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:21:33.505516+0000 mon.smithi099 (mon.0) 838 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:21:34.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:21:33.506971+0000 mon.smithi099 (mon.0) 839 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:21:34.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:21:33.515020+0000 mon.smithi099 (mon.0) 840 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:21:34.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 500471 46.56 MB/sec execute 459 sec latency 499.152 ms 2024-02-19T22:21:35.202 INFO:tasks.workunit.client.1.smithi138.stdout: 10 251059 22.40 MB/sec execute 463 sec latency 95.121 ms 2024-02-19T22:21:35.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 501354 46.56 MB/sec execute 460 sec latency 434.948 ms 2024-02-19T22:21:36.202 INFO:tasks.workunit.client.1.smithi138.stdout: 10 251575 22.41 MB/sec execute 464 sec latency 85.110 ms 2024-02-19T22:21:36.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:34.738346+0000 mgr.smithi099.zfglya (mgr.14180) 955 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 422 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 9.2 MiB/s wr, 452 op/s 2024-02-19T22:21:36.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:34.738346+0000 mgr.smithi099.zfglya (mgr.14180) 955 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 422 MiB data, 8.0 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 9.2 MiB/s wr, 452 op/s 2024-02-19T22:21:36.858 INFO:tasks.workunit.client.0.smithi099.stdout: 10 501749 46.50 MB/sec execute 461 sec latency 84.022 ms 2024-02-19T22:21:37.203 INFO:tasks.workunit.client.1.smithi138.stdout: 10 252037 22.42 MB/sec execute 465 sec latency 29.060 ms 2024-02-19T22:21:37.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 502782 46.50 MB/sec execute 462 sec latency 104.839 ms 2024-02-19T22:21:38.203 INFO:tasks.workunit.client.1.smithi138.stdout: 10 252496 22.44 MB/sec execute 466 sec latency 110.409 ms 2024-02-19T22:21:38.702 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:36.738929+0000 mgr.smithi099.zfglya (mgr.14180) 956 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 415 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 416 op/s 2024-02-19T22:21:38.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:36.738929+0000 mgr.smithi099.zfglya (mgr.14180) 956 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 415 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 416 op/s 2024-02-19T22:21:38.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 504117 46.58 MB/sec execute 463 sec latency 126.256 ms 2024-02-19T22:21:39.203 INFO:tasks.workunit.client.1.smithi138.stdout: 10 252872 22.44 MB/sec execute 467 sec latency 120.902 ms 2024-02-19T22:21:39.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 505227 46.61 MB/sec execute 464 sec latency 110.257 ms 2024-02-19T22:21:40.203 INFO:tasks.workunit.client.1.smithi138.stdout: 10 253168 22.41 MB/sec execute 468 sec latency 112.731 ms 2024-02-19T22:21:40.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:38.739455+0000 mgr.smithi099.zfglya (mgr.14180) 957 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 409 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 9.8 MiB/s wr, 448 op/s 2024-02-19T22:21:40.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:38.739455+0000 mgr.smithi099.zfglya (mgr.14180) 957 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 409 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 9.8 MiB/s wr, 448 op/s 2024-02-19T22:21:40.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 505409 46.52 MB/sec execute 465 sec latency 111.596 ms 2024-02-19T22:21:41.203 INFO:tasks.workunit.client.1.smithi138.stdout: 10 253516 22.41 MB/sec execute 469 sec latency 96.977 ms 2024-02-19T22:21:41.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 506920 46.56 MB/sec execute 466 sec latency 117.848 ms 2024-02-19T22:21:42.203 INFO:tasks.workunit.client.1.smithi138.stdout: 10 253876 22.39 MB/sec execute 470 sec latency 136.238 ms 2024-02-19T22:21:42.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:40.739954+0000 mgr.smithi099.zfglya (mgr.14180) 958 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 419 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 451 op/s 2024-02-19T22:21:42.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:40.739954+0000 mgr.smithi099.zfglya (mgr.14180) 958 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 419 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 451 op/s 2024-02-19T22:21:42.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 508444 46.68 MB/sec execute 467 sec latency 107.783 ms 2024-02-19T22:21:43.203 INFO:tasks.workunit.client.1.smithi138.stdout: 10 254318 22.38 MB/sec execute 471 sec latency 101.756 ms 2024-02-19T22:21:43.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 508822 46.62 MB/sec execute 468 sec latency 108.742 ms 2024-02-19T22:21:44.203 INFO:tasks.workunit.client.1.smithi138.stdout: 10 254710 22.39 MB/sec execute 472 sec latency 85.526 ms 2024-02-19T22:21:44.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:42.740508+0000 mgr.smithi099.zfglya (mgr.14180) 959 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 420 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 10 MiB/s wr, 493 op/s 2024-02-19T22:21:44.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:42.740508+0000 mgr.smithi099.zfglya (mgr.14180) 959 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 420 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 10 MiB/s wr, 493 op/s 2024-02-19T22:21:44.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 509627 46.62 MB/sec execute 469 sec latency 101.994 ms 2024-02-19T22:21:45.203 INFO:tasks.workunit.client.1.smithi138.stdout: 10 255268 22.40 MB/sec execute 473 sec latency 93.518 ms 2024-02-19T22:21:45.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 510931 46.67 MB/sec execute 470 sec latency 152.321 ms 2024-02-19T22:21:46.203 INFO:tasks.workunit.client.1.smithi138.stdout: 10 255672 22.42 MB/sec execute 474 sec latency 89.798 ms 2024-02-19T22:21:46.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:44.741007+0000 mgr.smithi099.zfglya (mgr.14180) 960 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 416 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 8.6 MiB/s wr, 420 op/s 2024-02-19T22:21:46.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:44.741007+0000 mgr.smithi099.zfglya (mgr.14180) 960 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 416 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 8.6 MiB/s wr, 420 op/s 2024-02-19T22:21:46.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 511356 46.62 MB/sec execute 471 sec latency 343.556 ms 2024-02-19T22:21:47.203 INFO:tasks.workunit.client.1.smithi138.stdout: 10 256060 22.42 MB/sec execute 475 sec latency 112.586 ms 2024-02-19T22:21:47.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 512322 46.63 MB/sec execute 472 sec latency 108.508 ms 2024-02-19T22:21:48.203 INFO:tasks.workunit.client.1.smithi138.stdout: 10 256332 22.41 MB/sec execute 476 sec latency 142.809 ms 2024-02-19T22:21:48.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:46.741585+0000 mgr.smithi099.zfglya (mgr.14180) 961 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 409 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 452 op/s 2024-02-19T22:21:48.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:46.741585+0000 mgr.smithi099.zfglya (mgr.14180) 961 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 409 MiB data, 7.9 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 452 op/s 2024-02-19T22:21:48.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 512558 46.54 MB/sec execute 473 sec latency 97.405 ms 2024-02-19T22:21:49.203 INFO:tasks.workunit.client.1.smithi138.stdout: 10 256580 22.38 MB/sec execute 477 sec latency 123.084 ms 2024-02-19T22:21:49.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 514156 46.61 MB/sec execute 474 sec latency 112.691 ms 2024-02-19T22:21:50.204 INFO:tasks.workunit.client.1.smithi138.stdout: 10 256900 22.36 MB/sec execute 478 sec latency 153.390 ms 2024-02-19T22:21:50.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:48.742149+0000 mgr.smithi099.zfglya (mgr.14180) 962 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 408 MiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 9.8 MiB/s wr, 470 op/s 2024-02-19T22:21:50.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:48.742149+0000 mgr.smithi099.zfglya (mgr.14180) 962 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 408 MiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 9.8 MiB/s wr, 470 op/s 2024-02-19T22:21:50.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 515803 46.73 MB/sec execute 475 sec latency 107.927 ms 2024-02-19T22:21:51.207 INFO:tasks.workunit.client.1.smithi138.stdout: 10 257276 22.35 MB/sec execute 479 sec latency 152.589 ms 2024-02-19T22:21:51.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:51 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:50.742695+0000 mgr.smithi099.zfglya (mgr.14180) 963 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 416 MiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 510 op/s 2024-02-19T22:21:51.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:50.742695+0000 mgr.smithi099.zfglya (mgr.14180) 963 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 416 MiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 510 op/s 2024-02-19T22:21:51.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 515930 46.64 MB/sec execute 476 sec latency 90.335 ms 2024-02-19T22:21:52.207 INFO:tasks.workunit.client.1.smithi138.stdout: 10 257664 22.34 MB/sec execute 480 sec latency 82.897 ms 2024-02-19T22:21:52.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 516102 46.55 MB/sec execute 477 sec latency 326.278 ms 2024-02-19T22:21:53.207 INFO:tasks.workunit.client.1.smithi138.stdout: 10 258018 22.34 MB/sec execute 481 sec latency 119.842 ms 2024-02-19T22:21:53.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 517698 46.62 MB/sec execute 478 sec latency 119.615 ms 2024-02-19T22:21:54.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:53 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:52.743231+0000 mgr.smithi099.zfglya (mgr.14180) 964 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 411 MiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 497 op/s 2024-02-19T22:21:54.207 INFO:tasks.workunit.client.1.smithi138.stdout: 10 258406 22.34 MB/sec execute 482 sec latency 92.730 ms 2024-02-19T22:21:54.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:52.743231+0000 mgr.smithi099.zfglya (mgr.14180) 964 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 411 MiB data, 8.2 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 497 op/s 2024-02-19T22:21:54.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 519172 46.72 MB/sec execute 479 sec latency 132.964 ms 2024-02-19T22:21:55.207 INFO:tasks.workunit.client.1.smithi138.stdout: 10 258880 22.34 MB/sec execute 483 sec latency 68.955 ms 2024-02-19T22:21:55.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 519477 46.65 MB/sec execute 480 sec latency 97.452 ms 2024-02-19T22:21:56.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:55 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:54.743741+0000 mgr.smithi099.zfglya (mgr.14180) 965 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 407 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 8.6 MiB/s wr, 432 op/s 2024-02-19T22:21:56.210 INFO:tasks.workunit.client.1.smithi138.stdout: 10 259349 22.37 MB/sec execute 484 sec latency 62.879 ms 2024-02-19T22:21:56.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:54.743741+0000 mgr.smithi099.zfglya (mgr.14180) 965 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 407 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 8.6 MiB/s wr, 432 op/s 2024-02-19T22:21:56.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 520282 46.65 MB/sec execute 481 sec latency 113.350 ms 2024-02-19T22:21:57.210 INFO:tasks.workunit.client.1.smithi138.stdout: 10 259732 22.37 MB/sec execute 485 sec latency 139.857 ms 2024-02-19T22:21:57.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 521283 46.64 MB/sec execute 482 sec latency 270.287 ms 2024-02-19T22:21:58.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:57 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:56.744203+0000 mgr.smithi099.zfglya (mgr.14180) 966 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 408 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 430 op/s 2024-02-19T22:21:58.210 INFO:tasks.workunit.client.1.smithi138.stdout: 10 260110 22.36 MB/sec execute 486 sec latency 98.282 ms 2024-02-19T22:21:58.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:56.744203+0000 mgr.smithi099.zfglya (mgr.14180) 966 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 408 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 430 op/s 2024-02-19T22:21:58.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 521981 46.65 MB/sec execute 483 sec latency 357.138 ms 2024-02-19T22:21:59.213 INFO:tasks.workunit.client.1.smithi138.stdout: 10 260447 22.34 MB/sec execute 487 sec latency 107.355 ms 2024-02-19T22:21:59.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 522985 46.66 MB/sec execute 484 sec latency 100.274 ms 2024-02-19T22:22:00.202 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:21:59 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:21:58.744697+0000 mgr.smithi099.zfglya (mgr.14180) 967 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 418 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 9.9 MiB/s wr, 492 op/s 2024-02-19T22:22:00.213 INFO:tasks.workunit.client.1.smithi138.stdout: 10 260770 22.32 MB/sec execute 488 sec latency 119.434 ms 2024-02-19T22:22:00.294 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:21:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:21:58.744697+0000 mgr.smithi099.zfglya (mgr.14180) 967 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 418 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 9.9 MiB/s wr, 492 op/s 2024-02-19T22:22:00.859 INFO:tasks.workunit.client.0.smithi099.stdout: 10 523677 46.64 MB/sec execute 485 sec latency 100.271 ms 2024-02-19T22:22:01.214 INFO:tasks.workunit.client.1.smithi138.stdout: 10 261159 22.31 MB/sec execute 489 sec latency 154.155 ms 2024-02-19T22:22:01.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 525112 46.71 MB/sec execute 486 sec latency 115.741 ms 2024-02-19T22:22:02.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:01 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:00.745330+0000 mgr.smithi099.zfglya (mgr.14180) 968 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 422 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 468 op/s 2024-02-19T22:22:02.214 INFO:tasks.workunit.client.1.smithi138.stdout: 10 261545 22.31 MB/sec execute 490 sec latency 115.720 ms 2024-02-19T22:22:02.294 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:00.745330+0000 mgr.smithi099.zfglya (mgr.14180) 968 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 422 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 468 op/s 2024-02-19T22:22:02.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 526448 46.76 MB/sec execute 487 sec latency 129.008 ms 2024-02-19T22:22:03.214 INFO:tasks.workunit.client.1.smithi138.stdout: 10 262014 22.33 MB/sec execute 491 sec latency 89.296 ms 2024-02-19T22:22:03.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 526611 46.67 MB/sec execute 488 sec latency 84.202 ms 2024-02-19T22:22:04.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:02.745796+0000 mgr.smithi099.zfglya (mgr.14180) 969 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 412 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 8.9 MiB/s wr, 436 op/s 2024-02-19T22:22:04.214 INFO:tasks.workunit.client.1.smithi138.stdout: 10 262457 22.32 MB/sec execute 492 sec latency 80.671 ms 2024-02-19T22:22:04.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:02.745796+0000 mgr.smithi099.zfglya (mgr.14180) 969 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 412 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 8.9 MiB/s wr, 436 op/s 2024-02-19T22:22:04.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 527838 46.69 MB/sec execute 489 sec latency 104.039 ms 2024-02-19T22:22:05.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 262910 22.35 MB/sec execute 493 sec latency 60.330 ms 2024-02-19T22:22:05.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 529072 46.76 MB/sec execute 490 sec latency 112.598 ms 2024-02-19T22:22:06.203 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:04.746310+0000 mgr.smithi099.zfglya (mgr.14180) 970 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 411 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 8.4 MiB/s wr, 423 op/s 2024-02-19T22:22:06.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 263287 22.36 MB/sec execute 494 sec latency 108.030 ms 2024-02-19T22:22:06.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:04.746310+0000 mgr.smithi099.zfglya (mgr.14180) 970 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 411 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 8.4 MiB/s wr, 423 op/s 2024-02-19T22:22:06.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 530046 46.77 MB/sec execute 491 sec latency 110.958 ms 2024-02-19T22:22:07.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 263639 22.34 MB/sec execute 495 sec latency 124.798 ms 2024-02-19T22:22:07.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 530263 46.69 MB/sec execute 492 sec latency 118.753 ms 2024-02-19T22:22:08.204 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:06.746840+0000 mgr.smithi099.zfglya (mgr.14180) 971 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 418 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 452 op/s 2024-02-19T22:22:08.321 INFO:tasks.workunit.client.1.smithi138.stdout: 10 264000 22.31 MB/sec execute 496 sec latency 82.456 ms 2024-02-19T22:22:08.321 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:06.746840+0000 mgr.smithi099.zfglya (mgr.14180) 971 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 418 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 452 op/s 2024-02-19T22:22:08.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 531770 46.72 MB/sec execute 493 sec latency 114.336 ms 2024-02-19T22:22:09.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 264329 22.31 MB/sec execute 497 sec latency 124.854 ms 2024-02-19T22:22:09.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 532081 46.70 MB/sec execute 494 sec latency 507.295 ms 2024-02-19T22:22:10.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:08.747334+0000 mgr.smithi099.zfglya (mgr.14180) 972 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 426 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 11 MiB/s wr, 546 op/s 2024-02-19T22:22:10.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 264643 22.29 MB/sec execute 498 sec latency 143.982 ms 2024-02-19T22:22:10.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:08.747334+0000 mgr.smithi099.zfglya (mgr.14180) 972 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 426 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 18 KiB/s rd, 11 MiB/s wr, 546 op/s 2024-02-19T22:22:10.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 532308 46.64 MB/sec execute 495 sec latency 476.864 ms 2024-02-19T22:22:11.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 265064 22.29 MB/sec execute 499 sec latency 140.696 ms 2024-02-19T22:22:11.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 532544 46.57 MB/sec execute 496 sec latency 437.105 ms 2024-02-19T22:22:12.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:10.747839+0000 mgr.smithi099.zfglya (mgr.14180) 973 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 418 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 476 op/s 2024-02-19T22:22:12.216 INFO:tasks.workunit.client.1.smithi138.stdout: 10 265513 22.30 MB/sec execute 500 sec latency 111.097 ms 2024-02-19T22:22:12.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:10.747839+0000 mgr.smithi099.zfglya (mgr.14180) 973 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 418 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 476 op/s 2024-02-19T22:22:12.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 533573 46.59 MB/sec execute 497 sec latency 406.255 ms 2024-02-19T22:22:13.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 266006 22.30 MB/sec execute 501 sec latency 80.406 ms 2024-02-19T22:22:13.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 533750 46.50 MB/sec execute 498 sec latency 98.781 ms 2024-02-19T22:22:14.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:12.748349+0000 mgr.smithi099.zfglya (mgr.14180) 974 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 417 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 9.9 MiB/s wr, 542 op/s 2024-02-19T22:22:14.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 266382 22.32 MB/sec execute 502 sec latency 141.503 ms 2024-02-19T22:22:14.295 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:12.748349+0000 mgr.smithi099.zfglya (mgr.14180) 974 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 417 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 9.9 MiB/s wr, 542 op/s 2024-02-19T22:22:14.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 535110 46.53 MB/sec execute 499 sec latency 109.028 ms 2024-02-19T22:22:15.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 266689 22.31 MB/sec execute 503 sec latency 124.944 ms 2024-02-19T22:22:15.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 536210 46.59 MB/sec execute 500 sec latency 108.878 ms 2024-02-19T22:22:16.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:14.748833+0000 mgr.smithi099.zfglya (mgr.14180) 975 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 415 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 473 op/s 2024-02-19T22:22:16.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 266961 22.30 MB/sec execute 504 sec latency 130.509 ms 2024-02-19T22:22:16.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:14.748833+0000 mgr.smithi099.zfglya (mgr.14180) 975 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 415 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 473 op/s 2024-02-19T22:22:16.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 537196 46.60 MB/sec execute 501 sec latency 102.518 ms 2024-02-19T22:22:17.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 267276 22.28 MB/sec execute 505 sec latency 110.202 ms 2024-02-19T22:22:17.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 537344 46.52 MB/sec execute 502 sec latency 303.412 ms 2024-02-19T22:22:18.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:16.749306+0000 mgr.smithi099.zfglya (mgr.14180) 976 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 425 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 488 op/s 2024-02-19T22:22:18.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 267636 22.26 MB/sec execute 506 sec latency 102.439 ms 2024-02-19T22:22:18.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:16.749306+0000 mgr.smithi099.zfglya (mgr.14180) 976 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 425 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 488 op/s 2024-02-19T22:22:18.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 538653 46.54 MB/sec execute 503 sec latency 344.685 ms 2024-02-19T22:22:19.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 267987 22.25 MB/sec execute 507 sec latency 110.391 ms 2024-02-19T22:22:19.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 539752 46.60 MB/sec execute 504 sec latency 110.566 ms 2024-02-19T22:22:20.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:18.749773+0000 mgr.smithi099.zfglya (mgr.14180) 977 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 435 MiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 10 MiB/s wr, 519 op/s 2024-02-19T22:22:20.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 268388 22.25 MB/sec execute 508 sec latency 108.338 ms 2024-02-19T22:22:20.295 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:18.749773+0000 mgr.smithi099.zfglya (mgr.14180) 977 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 435 MiB data, 8.6 GiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 10 MiB/s wr, 519 op/s 2024-02-19T22:22:20.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 540745 46.61 MB/sec execute 505 sec latency 92.801 ms 2024-02-19T22:22:21.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 268792 22.25 MB/sec execute 509 sec latency 142.127 ms 2024-02-19T22:22:21.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 541218 46.57 MB/sec execute 506 sec latency 118.489 ms 2024-02-19T22:22:22.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:20.750359+0000 mgr.smithi099.zfglya (mgr.14180) 978 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 422 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 408 op/s 2024-02-19T22:22:22.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 269318 22.26 MB/sec execute 510 sec latency 76.223 ms 2024-02-19T22:22:22.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:20.750359+0000 mgr.smithi099.zfglya (mgr.14180) 978 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 422 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 408 op/s 2024-02-19T22:22:22.860 INFO:tasks.workunit.client.0.smithi099.stdout: 10 542720 46.63 MB/sec execute 507 sec latency 128.577 ms 2024-02-19T22:22:23.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 269764 22.28 MB/sec execute 511 sec latency 89.014 ms 2024-02-19T22:22:23.863 INFO:tasks.workunit.client.0.smithi099.stdout: 10 544011 46.69 MB/sec execute 508 sec latency 233.470 ms 2024-02-19T22:22:24.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:22.750931+0000 mgr.smithi099.zfglya (mgr.14180) 979 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 415 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 8.9 MiB/s wr, 438 op/s 2024-02-19T22:22:24.215 INFO:tasks.workunit.client.1.smithi138.stdout: 10 270190 22.29 MB/sec execute 512 sec latency 105.985 ms 2024-02-19T22:22:24.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:22.750931+0000 mgr.smithi099.zfglya (mgr.14180) 979 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 415 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 19 KiB/s rd, 8.9 MiB/s wr, 438 op/s 2024-02-19T22:22:24.863 INFO:tasks.workunit.client.0.smithi099.stdout: 10 544323 46.62 MB/sec execute 509 sec latency 98.741 ms 2024-02-19T22:22:25.223 INFO:tasks.workunit.client.1.smithi138.stdout: 10 270554 22.29 MB/sec execute 513 sec latency 83.281 ms 2024-02-19T22:22:25.863 INFO:tasks.workunit.client.0.smithi099.stdout: 10 545113 46.62 MB/sec execute 510 sec latency 104.635 ms 2024-02-19T22:22:26.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:24.751400+0000 mgr.smithi099.zfglya (mgr.14180) 980 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 418 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 8.3 MiB/s wr, 399 op/s 2024-02-19T22:22:26.223 INFO:tasks.workunit.client.1.smithi138.stdout: 10 270836 22.26 MB/sec execute 514 sec latency 92.888 ms 2024-02-19T22:22:26.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:24.751400+0000 mgr.smithi099.zfglya (mgr.14180) 980 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 418 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 8.3 MiB/s wr, 399 op/s 2024-02-19T22:22:26.863 INFO:tasks.workunit.client.0.smithi099.stdout: 10 546419 46.67 MB/sec execute 511 sec latency 123.150 ms 2024-02-19T22:22:27.223 INFO:tasks.workunit.client.1.smithi138.stdout: 10 271187 22.25 MB/sec execute 515 sec latency 123.932 ms 2024-02-19T22:22:27.863 INFO:tasks.workunit.client.0.smithi099.stdout: 10 547756 46.72 MB/sec execute 512 sec latency 113.172 ms 2024-02-19T22:22:28.203 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:26.751882+0000 mgr.smithi099.zfglya (mgr.14180) 981 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 427 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 422 op/s 2024-02-19T22:22:28.226 INFO:tasks.workunit.client.1.smithi138.stdout: 10 271512 22.23 MB/sec execute 516 sec latency 121.524 ms 2024-02-19T22:22:28.295 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:26.751882+0000 mgr.smithi099.zfglya (mgr.14180) 981 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 427 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 422 op/s 2024-02-19T22:22:28.863 INFO:tasks.workunit.client.0.smithi099.stdout: 10 547880 46.63 MB/sec execute 513 sec latency 139.430 ms 2024-02-19T22:22:29.227 INFO:tasks.workunit.client.1.smithi138.stdout: 10 271968 22.23 MB/sec execute 517 sec latency 110.225 ms 2024-02-19T22:22:29.863 INFO:tasks.workunit.client.0.smithi099.stdout: 10 548020 46.55 MB/sec execute 514 sec latency 374.575 ms 2024-02-19T22:22:30.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:28.752446+0000 mgr.smithi099.zfglya (mgr.14180) 982 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 427 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 20 KiB/s rd, 9.5 MiB/s wr, 466 op/s 2024-02-19T22:22:30.226 INFO:tasks.workunit.client.1.smithi138.stdout: 10 272345 22.23 MB/sec execute 518 sec latency 125.053 ms 2024-02-19T22:22:30.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:28.752446+0000 mgr.smithi099.zfglya (mgr.14180) 982 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 427 MiB data, 8.5 GiB used, 707 GiB / 715 GiB avail; 20 KiB/s rd, 9.5 MiB/s wr, 466 op/s 2024-02-19T22:22:30.863 INFO:tasks.workunit.client.0.smithi099.stdout: 10 549454 46.58 MB/sec execute 515 sec latency 129.609 ms 2024-02-19T22:22:31.227 INFO:tasks.workunit.client.1.smithi138.stdout: 10 272881 22.25 MB/sec execute 519 sec latency 90.252 ms 2024-02-19T22:22:31.863 INFO:tasks.workunit.client.0.smithi099.stdout: 10 550845 46.68 MB/sec execute 516 sec latency 104.836 ms 2024-02-19T22:22:32.204 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:30.752975+0000 mgr.smithi099.zfglya (mgr.14180) 983 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 419 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 14 KiB/s rd, 9.7 MiB/s wr, 446 op/s 2024-02-19T22:22:32.227 INFO:tasks.workunit.client.1.smithi138.stdout: 10 273265 22.25 MB/sec execute 520 sec latency 85.936 ms 2024-02-19T22:22:32.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:30.752975+0000 mgr.smithi099.zfglya (mgr.14180) 983 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 419 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 14 KiB/s rd, 9.7 MiB/s wr, 446 op/s 2024-02-19T22:22:32.863 INFO:tasks.workunit.client.0.smithi099.stdout: 10 551403 46.64 MB/sec execute 517 sec latency 102.803 ms 2024-02-19T22:22:33.229 INFO:tasks.workunit.client.1.smithi138.stdout: 10 273704 22.27 MB/sec execute 521 sec latency 122.963 ms 2024-02-19T22:22:33.864 INFO:tasks.workunit.client.0.smithi099.stdout: 10 552012 46.62 MB/sec execute 518 sec latency 114.210 ms 2024-02-19T22:22:34.202 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:32.753427+0000 mgr.smithi099.zfglya (mgr.14180) 984 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 418 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 10 MiB/s wr, 523 op/s 2024-02-19T22:22:34.203 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:22:33.524110+0000 mon.smithi099 (mon.0) 841 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:22:34.203 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:22:33.850715+0000 mon.smithi099 (mon.0) 842 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:22:34.229 INFO:tasks.workunit.client.1.smithi138.stdout: 10 273941 22.25 MB/sec execute 522 sec latency 107.715 ms 2024-02-19T22:22:34.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:32.753427+0000 mgr.smithi099.zfglya (mgr.14180) 984 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 418 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 10 MiB/s wr, 523 op/s 2024-02-19T22:22:34.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:22:33.524110+0000 mon.smithi099 (mon.0) 841 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:22:34.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:22:33.850715+0000 mon.smithi099 (mon.0) 842 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:22:34.864 INFO:tasks.workunit.client.0.smithi099.stdout: 10 553399 46.67 MB/sec execute 519 sec latency 120.741 ms 2024-02-19T22:22:35.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:22:34.278494+0000 mon.smithi099 (mon.0) 843 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:22:35.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:22:34.279379+0000 mon.smithi099 (mon.0) 844 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:22:35.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:22:34.284261+0000 mon.smithi099 (mon.0) 845 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:22:35.229 INFO:tasks.workunit.client.1.smithi138.stdout: 10 274328 22.24 MB/sec execute 523 sec latency 74.398 ms 2024-02-19T22:22:35.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:22:34.278494+0000 mon.smithi099 (mon.0) 843 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:22:35.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:22:34.279379+0000 mon.smithi099 (mon.0) 844 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:22:35.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:22:34.284261+0000 mon.smithi099 (mon.0) 845 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:22:35.864 INFO:tasks.workunit.client.0.smithi099.stdout: 10 554844 46.73 MB/sec execute 520 sec latency 115.980 ms 2024-02-19T22:22:36.230 INFO:tasks.workunit.client.1.smithi138.stdout: 10 274656 22.22 MB/sec execute 524 sec latency 106.983 ms 2024-02-19T22:22:36.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:34.753926+0000 mgr.smithi099.zfglya (mgr.14180) 985 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 420 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 465 op/s 2024-02-19T22:22:36.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:36 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:34.753926+0000 mgr.smithi099.zfglya (mgr.14180) 985 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 420 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 465 op/s 2024-02-19T22:22:36.864 INFO:tasks.workunit.client.0.smithi099.stdout: 10 555000 46.65 MB/sec execute 521 sec latency 89.982 ms 2024-02-19T22:22:37.231 INFO:tasks.workunit.client.1.smithi138.stdout: 10 275006 22.21 MB/sec execute 525 sec latency 130.790 ms 2024-02-19T22:22:37.864 INFO:tasks.workunit.client.0.smithi099.stdout: 10 556052 46.66 MB/sec execute 522 sec latency 143.303 ms 2024-02-19T22:22:38.231 INFO:tasks.workunit.client.1.smithi138.stdout: 10 275432 22.20 MB/sec execute 526 sec latency 101.127 ms 2024-02-19T22:22:38.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:38 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:36.754430+0000 mgr.smithi099.zfglya (mgr.14180) 986 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 426 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 435 op/s 2024-02-19T22:22:38.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:36.754430+0000 mgr.smithi099.zfglya (mgr.14180) 986 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 426 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 435 op/s 2024-02-19T22:22:38.864 INFO:tasks.workunit.client.0.smithi099.stdout: 10 557336 46.72 MB/sec execute 523 sec latency 115.243 ms 2024-02-19T22:22:39.231 INFO:tasks.workunit.client.1.smithi138.stdout: 10 275843 22.21 MB/sec execute 527 sec latency 149.114 ms 2024-02-19T22:22:39.864 INFO:tasks.workunit.client.0.smithi099.stdout: 10 558442 46.75 MB/sec execute 524 sec latency 100.007 ms 2024-02-19T22:22:40.231 INFO:tasks.workunit.client.1.smithi138.stdout: 10 276335 22.22 MB/sec execute 528 sec latency 151.223 ms 2024-02-19T22:22:40.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:40 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:38.754974+0000 mgr.smithi099.zfglya (mgr.14180) 987 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 428 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 9.9 MiB/s wr, 543 op/s 2024-02-19T22:22:40.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:38.754974+0000 mgr.smithi099.zfglya (mgr.14180) 987 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 428 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 9.9 MiB/s wr, 543 op/s 2024-02-19T22:22:40.864 INFO:tasks.workunit.client.0.smithi099.stdout: 10 558623 46.67 MB/sec execute 525 sec latency 100.952 ms 2024-02-19T22:22:41.236 INFO:tasks.workunit.client.1.smithi138.stdout: 10 276710 22.22 MB/sec execute 529 sec latency 119.794 ms 2024-02-19T22:22:41.864 INFO:tasks.workunit.client.0.smithi099.stdout: 10 560095 46.70 MB/sec execute 526 sec latency 122.145 ms 2024-02-19T22:22:42.237 INFO:tasks.workunit.client.1.smithi138.stdout: 10 277203 22.24 MB/sec execute 530 sec latency 75.638 ms 2024-02-19T22:22:42.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:40.755450+0000 mgr.smithi099.zfglya (mgr.14180) 988 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 418 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 11 KiB/s rd, 9.8 MiB/s wr, 471 op/s 2024-02-19T22:22:42.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:40.755450+0000 mgr.smithi099.zfglya (mgr.14180) 988 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 418 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 11 KiB/s rd, 9.8 MiB/s wr, 471 op/s 2024-02-19T22:22:42.864 INFO:tasks.workunit.client.0.smithi099.stdout: 10 561483 46.79 MB/sec execute 527 sec latency 116.545 ms 2024-02-19T22:22:43.237 INFO:tasks.workunit.client.1.smithi138.stdout: 10 277541 22.24 MB/sec execute 531 sec latency 117.016 ms 2024-02-19T22:22:43.864 INFO:tasks.workunit.client.0.smithi099.stdout: 10 562038 46.76 MB/sec execute 528 sec latency 107.275 ms 2024-02-19T22:22:44.237 INFO:tasks.workunit.client.1.smithi138.stdout: 10 277837 22.22 MB/sec execute 532 sec latency 138.352 ms 2024-02-19T22:22:44.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:42.755867+0000 mgr.smithi099.zfglya (mgr.14180) 989 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 421 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 16 KiB/s rd, 10 MiB/s wr, 484 op/s 2024-02-19T22:22:44.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:42.755867+0000 mgr.smithi099.zfglya (mgr.14180) 989 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 421 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 16 KiB/s rd, 10 MiB/s wr, 484 op/s 2024-02-19T22:22:44.864 INFO:tasks.workunit.client.0.smithi099.stdout: 10 562717 46.74 MB/sec execute 529 sec latency 95.467 ms 2024-02-19T22:22:45.238 INFO:tasks.workunit.client.1.smithi138.stdout: 10 278112 22.20 MB/sec execute 533 sec latency 142.577 ms 2024-02-19T22:22:45.864 INFO:tasks.workunit.client.0.smithi099.stdout: 10 563374 46.69 MB/sec execute 530 sec latency 421.569 ms 2024-02-19T22:22:46.239 INFO:tasks.workunit.client.1.smithi138.stdout: 10 278506 22.20 MB/sec execute 534 sec latency 88.566 ms 2024-02-19T22:22:46.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:44.756287+0000 mgr.smithi099.zfglya (mgr.14180) 990 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 420 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 9.1 MiB/s wr, 416 op/s 2024-02-19T22:22:46.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:44.756287+0000 mgr.smithi099.zfglya (mgr.14180) 990 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 420 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 9.1 MiB/s wr, 416 op/s 2024-02-19T22:22:46.864 INFO:tasks.workunit.client.0.smithi099.stdout: 10 563645 46.62 MB/sec execute 531 sec latency 589.811 ms 2024-02-19T22:22:47.239 INFO:tasks.workunit.client.1.smithi138.stdout: 10 278937 22.18 MB/sec execute 535 sec latency 112.142 ms 2024-02-19T22:22:47.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 563995 46.60 MB/sec execute 532 sec latency 490.057 ms 2024-02-19T22:22:48.240 INFO:tasks.workunit.client.1.smithi138.stdout: 10 279333 22.19 MB/sec execute 536 sec latency 86.903 ms 2024-02-19T22:22:48.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:46.756875+0000 mgr.smithi099.zfglya (mgr.14180) 991 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 419 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 435 op/s 2024-02-19T22:22:48.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:46.756875+0000 mgr.smithi099.zfglya (mgr.14180) 991 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 419 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 435 op/s 2024-02-19T22:22:48.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 564301 46.55 MB/sec execute 533 sec latency 432.204 ms 2024-02-19T22:22:49.240 INFO:tasks.workunit.client.1.smithi138.stdout: 10 279827 22.20 MB/sec execute 537 sec latency 109.743 ms 2024-02-19T22:22:49.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 565472 46.58 MB/sec execute 534 sec latency 376.556 ms 2024-02-19T22:22:50.240 INFO:tasks.workunit.client.1.smithi138.stdout: 10 280228 22.20 MB/sec execute 538 sec latency 79.566 ms 2024-02-19T22:22:50.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:48.757339+0000 mgr.smithi099.zfglya (mgr.14180) 992 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 422 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 19 KiB/s rd, 9.9 MiB/s wr, 551 op/s 2024-02-19T22:22:50.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:48.757339+0000 mgr.smithi099.zfglya (mgr.14180) 992 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 422 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 19 KiB/s rd, 9.9 MiB/s wr, 551 op/s 2024-02-19T22:22:50.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 565599 46.50 MB/sec execute 535 sec latency 92.316 ms 2024-02-19T22:22:51.240 INFO:tasks.workunit.client.1.smithi138.stdout: 10 280600 22.21 MB/sec execute 539 sec latency 66.043 ms 2024-02-19T22:22:51.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 566508 46.50 MB/sec execute 536 sec latency 111.306 ms 2024-02-19T22:22:52.240 INFO:tasks.workunit.client.1.smithi138.stdout: 10 280925 22.20 MB/sec execute 540 sec latency 129.976 ms 2024-02-19T22:22:52.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:50.757819+0000 mgr.smithi099.zfglya (mgr.14180) 993 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 416 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 456 op/s 2024-02-19T22:22:52.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:50.757819+0000 mgr.smithi099.zfglya (mgr.14180) 993 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 416 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 456 op/s 2024-02-19T22:22:52.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 567844 46.56 MB/sec execute 537 sec latency 106.104 ms 2024-02-19T22:22:53.241 INFO:tasks.workunit.client.1.smithi138.stdout: 10 281240 22.20 MB/sec execute 541 sec latency 153.100 ms 2024-02-19T22:22:53.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 569044 46.59 MB/sec execute 538 sec latency 118.063 ms 2024-02-19T22:22:54.241 INFO:tasks.workunit.client.1.smithi138.stdout: 10 281530 22.17 MB/sec execute 542 sec latency 86.637 ms 2024-02-19T22:22:54.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:52.758296+0000 mgr.smithi099.zfglya (mgr.14180) 994 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 414 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 9.5 MiB/s wr, 428 op/s 2024-02-19T22:22:54.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:52.758296+0000 mgr.smithi099.zfglya (mgr.14180) 994 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 414 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 9.5 MiB/s wr, 428 op/s 2024-02-19T22:22:54.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 569176 46.51 MB/sec execute 539 sec latency 102.241 ms 2024-02-19T22:22:55.241 INFO:tasks.workunit.client.1.smithi138.stdout: 10 281830 22.16 MB/sec execute 543 sec latency 150.230 ms 2024-02-19T22:22:55.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 570326 46.52 MB/sec execute 540 sec latency 110.365 ms 2024-02-19T22:22:56.241 INFO:tasks.workunit.client.1.smithi138.stdout: 10 282103 22.14 MB/sec execute 544 sec latency 123.749 ms 2024-02-19T22:22:56.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:54.758734+0000 mgr.smithi099.zfglya (mgr.14180) 995 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 416 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 8.6 MiB/s wr, 401 op/s 2024-02-19T22:22:56.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:54.758734+0000 mgr.smithi099.zfglya (mgr.14180) 995 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 416 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 8.6 MiB/s wr, 401 op/s 2024-02-19T22:22:56.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 571614 46.59 MB/sec execute 541 sec latency 112.066 ms 2024-02-19T22:22:57.242 INFO:tasks.workunit.client.1.smithi138.stdout: 10 282449 22.12 MB/sec execute 545 sec latency 104.032 ms 2024-02-19T22:22:57.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 572626 46.60 MB/sec execute 542 sec latency 107.418 ms 2024-02-19T22:22:58.241 INFO:tasks.workunit.client.1.smithi138.stdout: 10 282796 22.12 MB/sec execute 546 sec latency 106.147 ms 2024-02-19T22:22:58.703 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:22:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:56.759241+0000 mgr.smithi099.zfglya (mgr.14180) 996 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 421 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 449 op/s 2024-02-19T22:22:58.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:22:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:56.759241+0000 mgr.smithi099.zfglya (mgr.14180) 996 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 421 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 10 MiB/s wr, 449 op/s 2024-02-19T22:22:58.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 572852 46.53 MB/sec execute 543 sec latency 88.441 ms 2024-02-19T22:22:59.241 INFO:tasks.workunit.client.1.smithi138.stdout: 10 283298 22.14 MB/sec execute 547 sec latency 71.735 ms 2024-02-19T22:22:59.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 574118 46.55 MB/sec execute 544 sec latency 250.840 ms 2024-02-19T22:23:00.241 INFO:tasks.workunit.client.1.smithi138.stdout: 10 283746 22.14 MB/sec execute 548 sec latency 85.117 ms 2024-02-19T22:23:00.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:22:58.759693+0000 mgr.smithi099.zfglya (mgr.14180) 997 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 415 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 19 KiB/s rd, 9.1 MiB/s wr, 490 op/s 2024-02-19T22:23:00.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:22:58.759693+0000 mgr.smithi099.zfglya (mgr.14180) 997 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 415 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 19 KiB/s rd, 9.1 MiB/s wr, 490 op/s 2024-02-19T22:23:00.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 575198 46.61 MB/sec execute 545 sec latency 138.053 ms 2024-02-19T22:23:01.241 INFO:tasks.workunit.client.1.smithi138.stdout: 10 284184 22.16 MB/sec execute 549 sec latency 92.359 ms 2024-02-19T22:23:01.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 576175 46.61 MB/sec execute 546 sec latency 106.958 ms 2024-02-19T22:23:02.245 INFO:tasks.workunit.client.1.smithi138.stdout: 10 284549 22.15 MB/sec execute 550 sec latency 118.536 ms 2024-02-19T22:23:02.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:00.760316+0000 mgr.smithi099.zfglya (mgr.14180) 998 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 419 MiB data, 8.7 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 433 op/s 2024-02-19T22:23:02.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:00.760316+0000 mgr.smithi099.zfglya (mgr.14180) 998 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 419 MiB data, 8.7 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 433 op/s 2024-02-19T22:23:02.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 576504 46.55 MB/sec execute 547 sec latency 104.311 ms 2024-02-19T22:23:03.244 INFO:tasks.workunit.client.1.smithi138.stdout: 10 284908 22.15 MB/sec execute 551 sec latency 119.030 ms 2024-02-19T22:23:03.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 577854 46.57 MB/sec execute 548 sec latency 122.320 ms 2024-02-19T22:23:04.248 INFO:tasks.workunit.client.1.smithi138.stdout: 10 285269 22.13 MB/sec execute 552 sec latency 130.727 ms 2024-02-19T22:23:04.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:04 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:02.760855+0000 mgr.smithi099.zfglya (mgr.14180) 999 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 416 MiB data, 8.7 GiB used, 706 GiB / 715 GiB avail; 17 KiB/s rd, 9.1 MiB/s wr, 428 op/s 2024-02-19T22:23:04.792 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:02.760855+0000 mgr.smithi099.zfglya (mgr.14180) 999 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 416 MiB data, 8.7 GiB used, 706 GiB / 715 GiB avail; 17 KiB/s rd, 9.1 MiB/s wr, 428 op/s 2024-02-19T22:23:04.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 579301 46.67 MB/sec execute 549 sec latency 129.415 ms 2024-02-19T22:23:05.248 INFO:tasks.workunit.client.1.smithi138.stdout: 10 285603 22.12 MB/sec execute 553 sec latency 173.352 ms 2024-02-19T22:23:05.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:05 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:04.761709+0000 mgr.smithi099.zfglya (mgr.14180) 1000 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 422 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 11 KiB/s rd, 8.7 MiB/s wr, 463 op/s 2024-02-19T22:23:05.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:05 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:04.761709+0000 mgr.smithi099.zfglya (mgr.14180) 1000 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 422 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 11 KiB/s rd, 8.7 MiB/s wr, 463 op/s 2024-02-19T22:23:05.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 579680 46.62 MB/sec execute 550 sec latency 357.399 ms 2024-02-19T22:23:06.248 INFO:tasks.workunit.client.1.smithi138.stdout: 10 286051 22.11 MB/sec execute 554 sec latency 115.487 ms 2024-02-19T22:23:06.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 579782 46.54 MB/sec execute 551 sec latency 389.526 ms 2024-02-19T22:23:07.248 INFO:tasks.workunit.client.1.smithi138.stdout: 10 286449 22.12 MB/sec execute 555 sec latency 118.309 ms 2024-02-19T22:23:07.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 580555 46.54 MB/sec execute 552 sec latency 114.436 ms 2024-02-19T22:23:08.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:07 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:06.762213+0000 mgr.smithi099.zfglya (mgr.14180) 1001 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 420 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 11 KiB/s rd, 9.7 MiB/s wr, 466 op/s 2024-02-19T22:23:08.248 INFO:tasks.workunit.client.1.smithi138.stdout: 10 286945 22.13 MB/sec execute 556 sec latency 137.967 ms 2024-02-19T22:23:08.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:07 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:06.762213+0000 mgr.smithi099.zfglya (mgr.14180) 1001 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 420 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 11 KiB/s rd, 9.7 MiB/s wr, 466 op/s 2024-02-19T22:23:08.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 581877 46.58 MB/sec execute 553 sec latency 125.544 ms 2024-02-19T22:23:09.248 INFO:tasks.workunit.client.1.smithi138.stdout: 10 287365 22.13 MB/sec execute 557 sec latency 117.350 ms 2024-02-19T22:23:09.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 583227 46.63 MB/sec execute 554 sec latency 109.223 ms 2024-02-19T22:23:10.204 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:09 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:08.762683+0000 mgr.smithi099.zfglya (mgr.14180) 1002 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 422 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 9.2 MiB/s wr, 494 op/s 2024-02-19T22:23:10.248 INFO:tasks.workunit.client.1.smithi138.stdout: 10 287857 22.16 MB/sec execute 558 sec latency 87.866 ms 2024-02-19T22:23:10.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:09 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:08.762683+0000 mgr.smithi099.zfglya (mgr.14180) 1002 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 422 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 9.2 MiB/s wr, 494 op/s 2024-02-19T22:23:10.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 583382 46.55 MB/sec execute 555 sec latency 101.211 ms 2024-02-19T22:23:11.249 INFO:tasks.workunit.client.1.smithi138.stdout: 10 288222 22.16 MB/sec execute 559 sec latency 128.497 ms 2024-02-19T22:23:11.866 INFO:tasks.workunit.client.0.smithi099.stdout: 10 584422 46.55 MB/sec execute 556 sec latency 132.650 ms 2024-02-19T22:23:12.204 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:11 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:10.763139+0000 mgr.smithi099.zfglya (mgr.14180) 1003 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 421 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 467 op/s 2024-02-19T22:23:12.248 INFO:tasks.workunit.client.1.smithi138.stdout: 10 288561 22.14 MB/sec execute 560 sec latency 84.362 ms 2024-02-19T22:23:12.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:11 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:10.763139+0000 mgr.smithi099.zfglya (mgr.14180) 1003 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 421 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 467 op/s 2024-02-19T22:23:12.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 585674 46.61 MB/sec execute 557 sec latency 140.856 ms 2024-02-19T22:23:13.249 INFO:tasks.workunit.client.1.smithi138.stdout: 10 288968 22.14 MB/sec execute 561 sec latency 88.020 ms 2024-02-19T22:23:13.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 586786 46.64 MB/sec execute 558 sec latency 136.588 ms 2024-02-19T22:23:14.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:13 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:12.763643+0000 mgr.smithi099.zfglya (mgr.14180) 1004 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 431 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 11 MiB/s wr, 474 op/s 2024-02-19T22:23:14.249 INFO:tasks.workunit.client.1.smithi138.stdout: 10 289250 22.11 MB/sec execute 562 sec latency 91.495 ms 2024-02-19T22:23:14.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:13 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:12.763643+0000 mgr.smithi099.zfglya (mgr.14180) 1004 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 431 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 11 MiB/s wr, 474 op/s 2024-02-19T22:23:14.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 586967 46.56 MB/sec execute 559 sec latency 100.946 ms 2024-02-19T22:23:15.251 INFO:tasks.workunit.client.1.smithi138.stdout: 10 289707 22.11 MB/sec execute 563 sec latency 140.346 ms 2024-02-19T22:23:15.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 588100 46.57 MB/sec execute 560 sec latency 152.447 ms 2024-02-19T22:23:16.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:15 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:14.764173+0000 mgr.smithi099.zfglya (mgr.14180) 1005 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 420 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 13 KiB/s rd, 9.5 MiB/s wr, 444 op/s 2024-02-19T22:23:16.249 INFO:tasks.workunit.client.1.smithi138.stdout: 10 290131 22.12 MB/sec execute 564 sec latency 107.776 ms 2024-02-19T22:23:16.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:15 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:14.764173+0000 mgr.smithi099.zfglya (mgr.14180) 1005 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 420 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 13 KiB/s rd, 9.5 MiB/s wr, 444 op/s 2024-02-19T22:23:16.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 589249 46.62 MB/sec execute 561 sec latency 138.543 ms 2024-02-19T22:23:17.249 INFO:tasks.workunit.client.1.smithi138.stdout: 10 290681 22.13 MB/sec execute 565 sec latency 99.662 ms 2024-02-19T22:23:17.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 590357 46.65 MB/sec execute 562 sec latency 96.348 ms 2024-02-19T22:23:18.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:17 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:16.764644+0000 mgr.smithi099.zfglya (mgr.14180) 1006 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 414 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 448 op/s 2024-02-19T22:23:18.249 INFO:tasks.workunit.client.1.smithi138.stdout: 10 291113 22.15 MB/sec execute 566 sec latency 82.618 ms 2024-02-19T22:23:18.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:17 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:16.764644+0000 mgr.smithi099.zfglya (mgr.14180) 1006 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 414 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 448 op/s 2024-02-19T22:23:18.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 590521 46.57 MB/sec execute 563 sec latency 142.501 ms 2024-02-19T22:23:19.249 INFO:tasks.workunit.client.1.smithi138.stdout: 10 291570 22.16 MB/sec execute 567 sec latency 111.921 ms 2024-02-19T22:23:19.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 591701 46.58 MB/sec execute 564 sec latency 122.289 ms 2024-02-19T22:23:20.202 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:19 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:18.765145+0000 mgr.smithi099.zfglya (mgr.14180) 1007 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 416 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 20 KiB/s rd, 10 MiB/s wr, 481 op/s 2024-02-19T22:23:20.249 INFO:tasks.workunit.client.1.smithi138.stdout: 10 291870 22.15 MB/sec execute 568 sec latency 318.035 ms 2024-02-19T22:23:20.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:19 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:18.765145+0000 mgr.smithi099.zfglya (mgr.14180) 1007 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 416 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 20 KiB/s rd, 10 MiB/s wr, 481 op/s 2024-02-19T22:23:20.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 592892 46.64 MB/sec execute 565 sec latency 132.433 ms 2024-02-19T22:23:21.249 INFO:tasks.workunit.client.1.smithi138.stdout: 10 292177 22.13 MB/sec execute 569 sec latency 129.145 ms 2024-02-19T22:23:21.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 593859 46.65 MB/sec execute 566 sec latency 373.087 ms 2024-02-19T22:23:22.203 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:20.765600+0000 mgr.smithi099.zfglya (mgr.14180) 1008 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 424 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 496 op/s 2024-02-19T22:23:22.249 INFO:tasks.workunit.client.1.smithi138.stdout: 10 292565 22.13 MB/sec execute 570 sec latency 111.007 ms 2024-02-19T22:23:22.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:21 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:20.765600+0000 mgr.smithi099.zfglya (mgr.14180) 1008 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 424 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 496 op/s 2024-02-19T22:23:22.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 593880 46.57 MB/sec execute 567 sec latency 619.292 ms 2024-02-19T22:23:23.249 INFO:tasks.workunit.client.1.smithi138.stdout: 10 292932 22.11 MB/sec execute 571 sec latency 105.567 ms 2024-02-19T22:23:23.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 593901 46.49 MB/sec execute 568 sec latency 698.178 ms 2024-02-19T22:23:24.203 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:23 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:22.766203+0000 mgr.smithi099.zfglya (mgr.14180) 1009 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 425 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 19 KiB/s rd, 10 MiB/s wr, 519 op/s 2024-02-19T22:23:24.254 INFO:tasks.workunit.client.1.smithi138.stdout: 10 293314 22.10 MB/sec execute 572 sec latency 106.995 ms 2024-02-19T22:23:24.294 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:23 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:22.766203+0000 mgr.smithi099.zfglya (mgr.14180) 1009 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 425 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 19 KiB/s rd, 10 MiB/s wr, 519 op/s 2024-02-19T22:23:24.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 593905 46.41 MB/sec execute 569 sec latency 682.885 ms 2024-02-19T22:23:25.255 INFO:tasks.workunit.client.1.smithi138.stdout: 10 293655 22.11 MB/sec execute 573 sec latency 128.013 ms 2024-02-19T22:23:25.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 594090 46.34 MB/sec execute 570 sec latency 616.441 ms 2024-02-19T22:23:26.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:25 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:24.766741+0000 mgr.smithi099.zfglya (mgr.14180) 1010 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 421 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 13 KiB/s rd, 9.1 MiB/s wr, 478 op/s 2024-02-19T22:23:26.256 INFO:tasks.workunit.client.1.smithi138.stdout: 10 294157 22.12 MB/sec execute 574 sec latency 82.011 ms 2024-02-19T22:23:26.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:25 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:24.766741+0000 mgr.smithi099.zfglya (mgr.14180) 1010 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 421 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 13 KiB/s rd, 9.1 MiB/s wr, 478 op/s 2024-02-19T22:23:26.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 595339 46.35 MB/sec execute 571 sec latency 134.834 ms 2024-02-19T22:23:27.256 INFO:tasks.workunit.client.1.smithi138.stdout: 10 294539 22.11 MB/sec execute 575 sec latency 85.304 ms 2024-02-19T22:23:27.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 596471 46.41 MB/sec execute 572 sec latency 131.290 ms 2024-02-19T22:23:28.202 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:27 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:26.767306+0000 mgr.smithi099.zfglya (mgr.14180) 1011 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 419 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 535 op/s 2024-02-19T22:23:28.255 INFO:tasks.workunit.client.1.smithi138.stdout: 10 295006 22.13 MB/sec execute 576 sec latency 112.311 ms 2024-02-19T22:23:28.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:27 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:26.767306+0000 mgr.smithi099.zfglya (mgr.14180) 1011 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 419 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 13 KiB/s rd, 11 MiB/s wr, 535 op/s 2024-02-19T22:23:28.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 597449 46.42 MB/sec execute 573 sec latency 107.503 ms 2024-02-19T22:23:29.258 INFO:tasks.workunit.client.1.smithi138.stdout: 10 295374 22.13 MB/sec execute 577 sec latency 106.163 ms 2024-02-19T22:23:29.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 597637 46.35 MB/sec execute 574 sec latency 102.596 ms 2024-02-19T22:23:30.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:28.767866+0000 mgr.smithi099.zfglya (mgr.14180) 1012 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 409 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 19 KiB/s rd, 9.9 MiB/s wr, 515 op/s 2024-02-19T22:23:30.259 INFO:tasks.workunit.client.1.smithi138.stdout: 10 295673 22.11 MB/sec execute 578 sec latency 110.959 ms 2024-02-19T22:23:30.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:29 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:28.767866+0000 mgr.smithi099.zfglya (mgr.14180) 1012 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 409 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 19 KiB/s rd, 9.9 MiB/s wr, 515 op/s 2024-02-19T22:23:30.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 598886 46.36 MB/sec execute 575 sec latency 200.808 ms 2024-02-19T22:23:31.263 INFO:tasks.workunit.client.1.smithi138.stdout: 10 296045 22.11 MB/sec execute 579 sec latency 117.406 ms 2024-02-19T22:23:31.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 600018 46.42 MB/sec execute 576 sec latency 127.879 ms 2024-02-19T22:23:32.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:31 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:30.770018+0000 mgr.smithi099.zfglya (mgr.14180) 1013 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 417 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 11 KiB/s rd, 11 MiB/s wr, 493 op/s 2024-02-19T22:23:32.261 INFO:tasks.workunit.client.1.smithi138.stdout: 10 296377 22.09 MB/sec execute 580 sec latency 110.346 ms 2024-02-19T22:23:32.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:31 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:30.770018+0000 mgr.smithi099.zfglya (mgr.14180) 1013 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 417 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 11 KiB/s rd, 11 MiB/s wr, 493 op/s 2024-02-19T22:23:32.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 600996 46.43 MB/sec execute 577 sec latency 91.625 ms 2024-02-19T22:23:33.264 INFO:tasks.workunit.client.1.smithi138.stdout: 10 296782 22.08 MB/sec execute 581 sec latency 76.794 ms 2024-02-19T22:23:33.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 601395 46.38 MB/sec execute 578 sec latency 98.445 ms 2024-02-19T22:23:34.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:33 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:32.770491+0000 mgr.smithi099.zfglya (mgr.14180) 1014 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 419 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 9.3 MiB/s wr, 439 op/s 2024-02-19T22:23:34.265 INFO:tasks.workunit.client.1.smithi138.stdout: 10 297158 22.09 MB/sec execute 582 sec latency 133.152 ms 2024-02-19T22:23:34.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:32.770491+0000 mgr.smithi099.zfglya (mgr.14180) 1014 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 419 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 9.3 MiB/s wr, 439 op/s 2024-02-19T22:23:34.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 602794 46.41 MB/sec execute 579 sec latency 129.323 ms 2024-02-19T22:23:35.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:23:34.291414+0000 mon.smithi099 (mon.0) 846 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:23:35.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:34 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:23:34.642386+0000 mon.smithi099 (mon.0) 847 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:23:35.266 INFO:tasks.workunit.client.1.smithi138.stdout: 10 297657 22.10 MB/sec execute 583 sec latency 114.416 ms 2024-02-19T22:23:35.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:23:34.291414+0000 mon.smithi099 (mon.0) 846 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T22:23:35.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:23:34.642386+0000 mon.smithi099 (mon.0) 847 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:23:35.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 604124 46.48 MB/sec execute 580 sec latency 185.682 ms 2024-02-19T22:23:36.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:34.770921+0000 mgr.smithi099.zfglya (mgr.14180) 1015 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 422 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 8.7 MiB/s wr, 434 op/s 2024-02-19T22:23:36.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:23:35.110671+0000 mon.smithi099 (mon.0) 848 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:23:36.202 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:23:35.111691+0000 mon.smithi099 (mon.0) 849 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:23:36.202 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:35 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: audit 2024-02-19T22:23:35.116843+0000 mon.smithi099 (mon.0) 850 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:23:36.265 INFO:tasks.workunit.client.1.smithi138.stdout: 10 298025 22.09 MB/sec execute 584 sec latency 99.621 ms 2024-02-19T22:23:36.294 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:34.770921+0000 mgr.smithi099.zfglya (mgr.14180) 1015 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 422 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 8.7 MiB/s wr, 434 op/s 2024-02-19T22:23:36.294 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:23:35.110671+0000 mon.smithi099 (mon.0) 848 : audit [DBG] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T22:23:36.294 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:23:35.111691+0000 mon.smithi099 (mon.0) 849 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T22:23:36.294 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: audit 2024-02-19T22:23:35.116843+0000 mon.smithi099 (mon.0) 850 : audit [INF] from='mgr.14180 172.21.15.99:0/3318537717' entity='mgr.smithi099.zfglya' 2024-02-19T22:23:36.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 604588 46.44 MB/sec execute 581 sec latency 113.653 ms 2024-02-19T22:23:37.267 INFO:tasks.workunit.client.1.smithi138.stdout: 10 298482 22.11 MB/sec execute 585 sec latency 76.625 ms 2024-02-19T22:23:37.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 605023 46.40 MB/sec execute 582 sec latency 143.623 ms 2024-02-19T22:23:38.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:37 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:36.771380+0000 mgr.smithi099.zfglya (mgr.14180) 1016 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 417 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 417 op/s 2024-02-19T22:23:38.267 INFO:tasks.workunit.client.1.smithi138.stdout: 10 298823 22.10 MB/sec execute 586 sec latency 149.091 ms 2024-02-19T22:23:38.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:36.771380+0000 mgr.smithi099.zfglya (mgr.14180) 1016 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 417 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 417 op/s 2024-02-19T22:23:38.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 606410 46.43 MB/sec execute 583 sec latency 130.862 ms 2024-02-19T22:23:39.268 INFO:tasks.workunit.client.1.smithi138.stdout: 10 299095 22.09 MB/sec execute 587 sec latency 153.081 ms 2024-02-19T22:23:39.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 607757 46.50 MB/sec execute 584 sec latency 129.409 ms 2024-02-19T22:23:40.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:39 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:38.771853+0000 mgr.smithi099.zfglya (mgr.14180) 1017 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 421 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 9.5 MiB/s wr, 438 op/s 2024-02-19T22:23:40.270 INFO:tasks.workunit.client.1.smithi138.stdout: 10 299324 22.07 MB/sec execute 588 sec latency 119.936 ms 2024-02-19T22:23:40.295 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:38.771853+0000 mgr.smithi099.zfglya (mgr.14180) 1017 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 421 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 9.5 MiB/s wr, 438 op/s 2024-02-19T22:23:40.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 608084 46.45 MB/sec execute 585 sec latency 316.840 ms 2024-02-19T22:23:41.270 INFO:tasks.workunit.client.1.smithi138.stdout: 10 299610 22.06 MB/sec execute 589 sec latency 83.897 ms 2024-02-19T22:23:41.867 INFO:tasks.workunit.client.0.smithi099.stdout: 10 608154 46.37 MB/sec execute 586 sec latency 383.211 ms 2024-02-19T22:23:42.270 INFO:tasks.workunit.client.1.smithi138.stdout: 10 299995 22.05 MB/sec execute 590 sec latency 79.865 ms 2024-02-19T22:23:42.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:42 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:40.772313+0000 mgr.smithi099.zfglya (mgr.14180) 1018 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 422 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 476 op/s 2024-02-19T22:23:42.549 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:40.772313+0000 mgr.smithi099.zfglya (mgr.14180) 1018 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 422 MiB data, 8.8 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 11 MiB/s wr, 476 op/s 2024-02-19T22:23:42.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 609083 46.37 MB/sec execute 587 sec latency 126.805 ms 2024-02-19T22:23:43.270 INFO:tasks.workunit.client.1.smithi138.stdout: 10 300419 22.04 MB/sec execute 591 sec latency 89.848 ms 2024-02-19T22:23:43.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 610375 46.42 MB/sec execute 588 sec latency 128.865 ms 2024-02-19T22:23:44.270 INFO:tasks.workunit.client.1.smithi138.stdout: 10 300764 22.04 MB/sec execute 592 sec latency 132.789 ms 2024-02-19T22:23:44.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:44 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:42.772841+0000 mgr.smithi099.zfglya (mgr.14180) 1019 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 421 MiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 512 op/s 2024-02-19T22:23:44.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:42.772841+0000 mgr.smithi099.zfglya (mgr.14180) 1019 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 421 MiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 512 op/s 2024-02-19T22:23:44.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 611610 46.46 MB/sec execute 589 sec latency 110.361 ms 2024-02-19T22:23:45.270 INFO:tasks.workunit.client.1.smithi138.stdout: 10 301238 22.05 MB/sec execute 593 sec latency 94.183 ms 2024-02-19T22:23:45.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 611750 46.38 MB/sec execute 590 sec latency 128.305 ms 2024-02-19T22:23:46.270 INFO:tasks.workunit.client.1.smithi138.stdout: 10 301576 22.04 MB/sec execute 594 sec latency 72.580 ms 2024-02-19T22:23:46.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:46 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:44.773276+0000 mgr.smithi099.zfglya (mgr.14180) 1020 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 414 MiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 440 op/s 2024-02-19T22:23:46.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:44.773276+0000 mgr.smithi099.zfglya (mgr.14180) 1020 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 414 MiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 440 op/s 2024-02-19T22:23:46.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 612876 46.39 MB/sec execute 591 sec latency 128.318 ms 2024-02-19T22:23:47.271 INFO:tasks.workunit.client.1.smithi138.stdout: 10 302029 22.06 MB/sec execute 595 sec latency 106.292 ms 2024-02-19T22:23:47.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 614145 46.45 MB/sec execute 592 sec latency 114.477 ms 2024-02-19T22:23:48.276 INFO:tasks.workunit.client.1.smithi138.stdout: 10 302415 22.06 MB/sec execute 596 sec latency 96.418 ms 2024-02-19T22:23:48.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:48 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:46.773758+0000 mgr.smithi099.zfglya (mgr.14180) 1021 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 419 MiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 9.5 MiB/s wr, 458 op/s 2024-02-19T22:23:48.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:46.773758+0000 mgr.smithi099.zfglya (mgr.14180) 1021 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 419 MiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 9.5 MiB/s wr, 458 op/s 2024-02-19T22:23:48.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 615172 46.47 MB/sec execute 593 sec latency 118.561 ms 2024-02-19T22:23:49.277 INFO:tasks.workunit.client.1.smithi138.stdout: 10 302778 22.05 MB/sec execute 597 sec latency 107.494 ms 2024-02-19T22:23:49.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 615380 46.40 MB/sec execute 594 sec latency 94.050 ms 2024-02-19T22:23:50.277 INFO:tasks.workunit.client.1.smithi138.stdout: 10 303092 22.03 MB/sec execute 598 sec latency 134.810 ms 2024-02-19T22:23:50.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:48.774249+0000 mgr.smithi099.zfglya (mgr.14180) 1022 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 425 MiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 17 KiB/s rd, 9.8 MiB/s wr, 509 op/s 2024-02-19T22:23:50.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:50 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:48.774249+0000 mgr.smithi099.zfglya (mgr.14180) 1022 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 425 MiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 17 KiB/s rd, 9.8 MiB/s wr, 509 op/s 2024-02-19T22:23:50.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 616857 46.43 MB/sec execute 595 sec latency 115.080 ms 2024-02-19T22:23:51.277 INFO:tasks.workunit.client.1.smithi138.stdout: 10 303459 22.03 MB/sec execute 599 sec latency 143.111 ms 2024-02-19T22:23:51.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 618305 46.52 MB/sec execute 596 sec latency 119.823 ms 2024-02-19T22:23:52.281 INFO:tasks.workunit.client.1.smithi138.stdout: 10 cleanup 600 sec 2024-02-19T22:23:52.544 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:50.774802+0000 mgr.smithi099.zfglya (mgr.14180) 1023 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 417 MiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 11 KiB/s rd, 10 MiB/s wr, 457 op/s 2024-02-19T22:23:52.675 INFO:tasks.workunit.client.1.smithi138.stdout: 0 cleanup 601 sec 2024-02-19T22:23:52.675 INFO:tasks.workunit.client.1.smithi138.stdout: 2024-02-19T22:23:52.676 INFO:tasks.workunit.client.1.smithi138.stdout: Operation Count AvgLat MaxLat 2024-02-19T22:23:52.676 INFO:tasks.workunit.client.1.smithi138.stdout: ---------------------------------------- 2024-02-19T22:23:52.676 INFO:tasks.workunit.client.1.smithi138.stdout: NTCreateX 423821 4.178 153.095 2024-02-19T22:23:52.676 INFO:tasks.workunit.client.1.smithi138.stdout: Close 311154 0.061 15.688 2024-02-19T22:23:52.676 INFO:tasks.workunit.client.1.smithi138.stdout: Rename 17963 11.177 150.957 2024-02-19T22:23:52.676 INFO:tasks.workunit.client.1.smithi138.stdout: Unlink 85677 2.864 38.469 2024-02-19T22:23:52.676 INFO:tasks.workunit.client.1.smithi138.stdout: Qpathinfo 384421 2.519 152.118 2024-02-19T22:23:52.676 INFO:tasks.workunit.client.1.smithi138.stdout: Qfileinfo 67028 0.135 10.729 2024-02-19T22:23:52.676 INFO:tasks.workunit.client.1.smithi138.stdout: Qfsinfo 70495 1.052 58.068 2024-02-19T22:23:52.676 INFO:tasks.workunit.client.1.smithi138.stdout: Sfileinfo 34515 0.901 19.679 2024-02-19T22:23:52.676 INFO:tasks.workunit.client.1.smithi138.stdout: Find 148609 14.547 175.920 2024-02-19T22:23:52.676 INFO:tasks.workunit.client.1.smithi138.stdout: WriteX 209485 0.272 96.254 2024-02-19T22:23:52.676 INFO:tasks.workunit.client.1.smithi138.stdout: ReadX 665359 0.005 14.416 2024-02-19T22:23:52.677 INFO:tasks.workunit.client.1.smithi138.stdout: LockX 1386 1.023 19.250 2024-02-19T22:23:52.677 INFO:tasks.workunit.client.1.smithi138.stdout: UnlockX 1386 0.623 14.386 2024-02-19T22:23:52.677 INFO:tasks.workunit.client.1.smithi138.stdout: Flush 29726 15.175 318.029 2024-02-19T22:23:52.677 INFO:tasks.workunit.client.1.smithi138.stdout: 2024-02-19T22:23:52.677 INFO:tasks.workunit.client.1.smithi138.stdout:Throughput 22.0314 MB/sec 10 clients 10 procs max_latency=318.035 ms 2024-02-19T22:23:52.678 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-19T22:23:52.678 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-19T22:23:52.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:52 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:50.774802+0000 mgr.smithi099.zfglya (mgr.14180) 1023 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 417 MiB data, 9.4 GiB used, 706 GiB / 715 GiB avail; 11 KiB/s rd, 10 MiB/s wr, 457 op/s 2024-02-19T22:23:52.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 618762 46.48 MB/sec execute 597 sec latency 95.068 ms 2024-02-19T22:23:52.937 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.1... 2024-02-19T22:23:52.937 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-19T22:23:53.222 DEBUG:teuthology.parallel:result is None 2024-02-19T22:23:53.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 619206 46.44 MB/sec execute 598 sec latency 107.186 ms 2024-02-19T22:23:54.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:52.775243+0000 mgr.smithi099.zfglya (mgr.14180) 1024 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 417 MiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 454 op/s 2024-02-19T22:23:54.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:54 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:52.775243+0000 mgr.smithi099.zfglya (mgr.14180) 1024 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 417 MiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 454 op/s 2024-02-19T22:23:54.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 620861 46.51 MB/sec execute 599 sec latency 107.396 ms 2024-02-19T22:23:55.868 INFO:tasks.workunit.client.0.smithi099.stdout: 10 cleanup 600 sec 2024-02-19T22:23:55.894 INFO:tasks.workunit.client.0.smithi099.stdout: 0 cleanup 600 sec 2024-02-19T22:23:55.894 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-02-19T22:23:55.894 INFO:tasks.workunit.client.0.smithi099.stdout: Operation Count AvgLat MaxLat 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: ---------------------------------------- 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: NTCreateX 890390 0.018 81.451 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: Close 654010 0.001 0.184 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: Rename 37710 0.082 78.622 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: Unlink 179840 0.128 120.140 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: Deltree 20 2.473 5.502 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: Mkdir 10 0.003 0.004 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: Qpathinfo 807180 0.012 120.079 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: Qfileinfo 141370 0.001 0.033 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: Qfsinfo 148000 0.002 0.044 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: Sfileinfo 72540 0.293 88.566 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: Find 312050 0.019 9.327 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: WriteX 443499 0.086 89.883 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: ReadX 1395930 0.007 86.695 2024-02-19T22:23:55.895 INFO:tasks.workunit.client.0.smithi099.stdout: LockX 2900 0.003 0.025 2024-02-19T22:23:55.896 INFO:tasks.workunit.client.0.smithi099.stdout: UnlockX 2900 0.002 0.023 2024-02-19T22:23:55.896 INFO:tasks.workunit.client.0.smithi099.stdout: Flush 62409 93.992 838.185 2024-02-19T22:23:55.896 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-02-19T22:23:55.896 INFO:tasks.workunit.client.0.smithi099.stdout:Throughput 46.5128 MB/sec 10 clients 10 procs max_latency=838.188 ms 2024-02-19T22:23:55.896 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-19T22:23:55.896 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-19T22:23:55.929 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-02-19T22:23:55.929 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-19T22:23:56.219 DEBUG:teuthology.parallel:result is None 2024-02-19T22:23:56.219 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-19T22:23:56.246 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-19T22:23:56.246 DEBUG:teuthology.orchestra.run.smithi099:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-02-19T22:23:56.304 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-02-19T22:23:56.304 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-19T22:23:56.340 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-19T22:23:56.340 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-02-19T22:23:56.349 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-02-19T22:23:56.350 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi138.front.sepia.ceph.com... 2024-02-19T22:23:56.350 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-02-19T22:23:56.350 DEBUG:teuthology.orchestra.run.smithi138:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-02-19T22:23:56.419 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi138.stderr:ceph-fuse[62707]: fuse finished with error 0 and tester_r 0 2024-02-19T22:23:56.420 INFO:teuthology.orchestra.run:waiting for 900 2024-02-19T22:23:56.548 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:54.775897+0000 mgr.smithi099.zfglya (mgr.14180) 1025 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 407 MiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 376 op/s 2024-02-19T22:23:56.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:56 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:54.775897+0000 mgr.smithi099.zfglya (mgr.14180) 1025 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 407 MiB data, 9.3 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 376 op/s 2024-02-19T22:23:58.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:23:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:56.776405+0000 mgr.smithi099.zfglya (mgr.14180) 1026 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 320 MiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 8.7 MiB/s wr, 441 op/s 2024-02-19T22:23:58.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:23:58 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:56.776405+0000 mgr.smithi099.zfglya (mgr.14180) 1026 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 320 MiB data, 9.1 GiB used, 706 GiB / 715 GiB avail; 12 KiB/s rd, 8.7 MiB/s wr, 441 op/s 2024-02-19T22:24:00.543 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:24:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:23:58.777117+0000 mgr.smithi099.zfglya (mgr.14180) 1027 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 239 MiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 21 KiB/s rd, 6.8 MiB/s wr, 381 op/s 2024-02-19T22:24:00.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:24:00 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:23:58.777117+0000 mgr.smithi099.zfglya (mgr.14180) 1027 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 239 MiB data, 8.9 GiB used, 706 GiB / 715 GiB avail; 21 KiB/s rd, 6.8 MiB/s wr, 381 op/s 2024-02-19T22:24:02.522 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2024-02-19T22:24:02.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T22:24:02.522 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-19T22:24:02.542 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:24:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: cluster 2024-02-19T22:24:00.777800+0000 mgr.smithi099.zfglya (mgr.14180) 1028 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 195 MiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 15 KiB/s rd, 4.9 MiB/s wr, 293 op/s 2024-02-19T22:24:02.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T22:24:02.640 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-02-19T22:24:02.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:24:02 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: cluster 2024-02-19T22:24:00.777800+0000 mgr.smithi099.zfglya (mgr.14180) 1028 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 195 MiB data, 8.7 GiB used, 707 GiB / 715 GiB avail; 15 KiB/s rd, 4.9 MiB/s wr, 293 op/s 2024-02-19T22:24:02.703 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-19T22:24:02.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T22:24:02.703 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T22:24:02.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T22:24:02.788 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2024-02-19T22:24:02.868 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-02-19T22:24:02.877 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-02-19T22:24:02.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T22:24:02.878 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-02-19T22:24:02.900 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-19T22:24:02.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T22:24:02.901 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T22:24:02.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T22:24:02.985 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-02-19T22:24:03.091 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-19T22:24:03.100 INFO:tasks.cephadm:Teardown begin 2024-02-19T22:24:03.101 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T22:24:03.133 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T22:24:03.167 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-19T22:24:03.167 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-19T22:24:03.192 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-19T22:24:03.226 INFO:tasks.cephadm:Stopping all daemons... 2024-02-19T22:24:03.227 INFO:tasks.cephadm.mon.smithi099:Stopping mon.smithi099... 2024-02-19T22:24:03.227 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-d4704266-cf70-11ee-95bb-87774f69a715@mon.smithi099 2024-02-19T22:24:03.546 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:24:03 smithi099 systemd[1]: Stopping Ceph mon.smithi099 for d4704266-cf70-11ee-95bb-87774f69a715... 2024-02-19T22:24:03.546 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:24:03 smithi099 bash[84628]: Error: no container with name or ID "ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon.smithi099" found: no such container 2024-02-19T22:24:03.951 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:24:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T22:24:03.542+0000 7f819de04700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi099 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-19T22:24:03.951 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:24:03 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099[37417]: debug 2024-02-19T22:24:03.542+0000 7f819de04700 -1 mon.smithi099@0(leader) e2 *** Got Signal Terminated *** 2024-02-19T22:24:04.451 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Feb 19 22:24:04 smithi099 bash[84669]: ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi099 2024-02-19T22:24:04.538 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@mon.smithi099.service' 2024-02-19T22:24:04.588 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:24:04.588 INFO:tasks.cephadm.mon.smithi099:Stopped mon.smithi099 2024-02-19T22:24:04.589 INFO:tasks.cephadm.mon.smithi138:Stopping mon.smithi138... 2024-02-19T22:24:04.589 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-d4704266-cf70-11ee-95bb-87774f69a715@mon.smithi138 2024-02-19T22:24:04.971 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:24:04 smithi138 systemd[1]: Stopping Ceph mon.smithi138 for d4704266-cf70-11ee-95bb-87774f69a715... 2024-02-19T22:24:04.971 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:24:04 smithi138 bash[82941]: Error: no container with name or ID "ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon.smithi138" found: no such container 2024-02-19T22:24:05.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:24:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T22:24:04.968+0000 7f805f086700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi138 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-19T22:24:05.293 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:24:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138[39832]: debug 2024-02-19T22:24:04.968+0000 7f805f086700 -1 mon.smithi138@1(peon) e2 *** Got Signal Terminated *** 2024-02-19T22:24:05.793 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 19 22:24:05 smithi138 bash[82980]: ceph-d4704266-cf70-11ee-95bb-87774f69a715-mon-smithi138 2024-02-19T22:24:05.921 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@mon.smithi138.service' 2024-02-19T22:24:05.967 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:24:05.968 INFO:tasks.cephadm.mon.smithi138:Stopped mon.smithi138 2024-02-19T22:24:05.968 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-19T22:24:05.968 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.0 2024-02-19T22:24:06.274 INFO:journalctl@ceph.osd.0.smithi099.stdout:Feb 19 22:24:06 smithi099 systemd[1]: Stopping Ceph osd.0 for d4704266-cf70-11ee-95bb-87774f69a715... 2024-02-19T22:24:06.274 INFO:journalctl@ceph.osd.0.smithi099.stdout:Feb 19 22:24:06 smithi099 bash[84802]: Error: no container with name or ID "ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd.0" found: no such container 2024-02-19T22:24:06.701 INFO:journalctl@ceph.osd.0.smithi099.stdout:Feb 19 22:24:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-0[51454]: debug 2024-02-19T22:24:06.271+0000 7f93f23c8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:24:06.701 INFO:journalctl@ceph.osd.0.smithi099.stdout:Feb 19 22:24:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-0[51454]: debug 2024-02-19T22:24:06.271+0000 7f93f23c8700 -1 osd.0 64 *** Got signal Terminated *** 2024-02-19T22:24:06.701 INFO:journalctl@ceph.osd.0.smithi099.stdout:Feb 19 22:24:06 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-0[51454]: debug 2024-02-19T22:24:06.271+0000 7f93f23c8700 -1 osd.0 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:24:12.201 INFO:journalctl@ceph.osd.0.smithi099.stdout:Feb 19 22:24:11 smithi099 bash[84843]: ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-0 2024-02-19T22:24:13.576 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.0.service' 2024-02-19T22:24:13.618 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:24:13.618 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-19T22:24:13.619 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-19T22:24:13.619 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.1 2024-02-19T22:24:13.951 INFO:journalctl@ceph.osd.1.smithi099.stdout:Feb 19 22:24:13 smithi099 systemd[1]: Stopping Ceph osd.1 for d4704266-cf70-11ee-95bb-87774f69a715... 2024-02-19T22:24:13.951 INFO:journalctl@ceph.osd.1.smithi099.stdout:Feb 19 22:24:13 smithi099 bash[85087]: Error: no container with name or ID "ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd.1" found: no such container 2024-02-19T22:24:14.451 INFO:journalctl@ceph.osd.1.smithi099.stdout:Feb 19 22:24:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-1[57013]: debug 2024-02-19T22:24:14.057+0000 7f126aac3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:24:14.451 INFO:journalctl@ceph.osd.1.smithi099.stdout:Feb 19 22:24:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-1[57013]: debug 2024-02-19T22:24:14.057+0000 7f126aac3700 -1 osd.1 64 *** Got signal Terminated *** 2024-02-19T22:24:14.452 INFO:journalctl@ceph.osd.1.smithi099.stdout:Feb 19 22:24:14 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-1[57013]: debug 2024-02-19T22:24:14.057+0000 7f126aac3700 -1 osd.1 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:24:19.951 INFO:journalctl@ceph.osd.1.smithi099.stdout:Feb 19 22:24:19 smithi099 bash[85126]: ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-1 2024-02-19T22:24:21.329 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.1.service' 2024-02-19T22:24:21.429 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:24:21.429 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-19T22:24:21.429 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-19T22:24:21.429 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.2 2024-02-19T22:24:21.701 INFO:journalctl@ceph.osd.2.smithi099.stdout:Feb 19 22:24:21 smithi099 systemd[1]: Stopping Ceph osd.2 for d4704266-cf70-11ee-95bb-87774f69a715... 2024-02-19T22:24:21.701 INFO:journalctl@ceph.osd.2.smithi099.stdout:Feb 19 22:24:21 smithi099 bash[85365]: Error: no container with name or ID "ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd.2" found: no such container 2024-02-19T22:24:22.201 INFO:journalctl@ceph.osd.2.smithi099.stdout:Feb 19 22:24:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-2[62358]: debug 2024-02-19T22:24:21.752+0000 7f9d1f779700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:24:22.201 INFO:journalctl@ceph.osd.2.smithi099.stdout:Feb 19 22:24:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-2[62358]: debug 2024-02-19T22:24:21.752+0000 7f9d1f779700 -1 osd.2 64 *** Got signal Terminated *** 2024-02-19T22:24:22.202 INFO:journalctl@ceph.osd.2.smithi099.stdout:Feb 19 22:24:21 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-2[62358]: debug 2024-02-19T22:24:21.752+0000 7f9d1f779700 -1 osd.2 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:24:27.451 INFO:journalctl@ceph.osd.2.smithi099.stdout:Feb 19 22:24:27 smithi099 bash[85406]: ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-2 2024-02-19T22:24:29.108 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.2.service' 2024-02-19T22:24:29.149 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:24:29.149 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-19T22:24:29.149 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-19T22:24:29.149 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.3 2024-02-19T22:24:29.451 INFO:journalctl@ceph.osd.3.smithi099.stdout:Feb 19 22:24:29 smithi099 systemd[1]: Stopping Ceph osd.3 for d4704266-cf70-11ee-95bb-87774f69a715... 2024-02-19T22:24:29.451 INFO:journalctl@ceph.osd.3.smithi099.stdout:Feb 19 22:24:29 smithi099 bash[85653]: Error: no container with name or ID "ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd.3" found: no such container 2024-02-19T22:24:29.951 INFO:journalctl@ceph.osd.3.smithi099.stdout:Feb 19 22:24:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-3[67792]: debug 2024-02-19T22:24:29.458+0000 7f31ca240700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:24:29.951 INFO:journalctl@ceph.osd.3.smithi099.stdout:Feb 19 22:24:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-3[67792]: debug 2024-02-19T22:24:29.458+0000 7f31ca240700 -1 osd.3 64 *** Got signal Terminated *** 2024-02-19T22:24:29.951 INFO:journalctl@ceph.osd.3.smithi099.stdout:Feb 19 22:24:29 smithi099 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-3[67792]: debug 2024-02-19T22:24:29.458+0000 7f31ca240700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:24:34.162 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:34.083+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:34.162 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:33 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:33.843+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:34.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:34.159+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:35.134 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4[44397]: debug 2024-02-19T22:24:34.935+0000 7f88c306f700 -1 osd.4 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:08.137076+0000 front 2024-02-19T22:24:08.137047+0000 (oldest deadline 2024-02-19T22:24:34.036809+0000) 2024-02-19T22:24:35.135 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:34 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:34.850+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:35.504 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:35.183+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:35.505 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:35.132+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:35.701 INFO:journalctl@ceph.osd.3.smithi099.stdout:Feb 19 22:24:35 smithi099 bash[85693]: ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-3 2024-02-19T22:24:36.141 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4[44397]: debug 2024-02-19T22:24:35.971+0000 7f88c306f700 -1 osd.4 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:08.137076+0000 front 2024-02-19T22:24:08.137047+0000 (oldest deadline 2024-02-19T22:24:34.036809+0000) 2024-02-19T22:24:36.142 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:35 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:35.859+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:36.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:36.139+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:36.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:36.178+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:37.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.3.service' 2024-02-19T22:24:37.151 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:24:37.151 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-19T22:24:37.151 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-19T22:24:37.152 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.4 2024-02-19T22:24:37.184 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4[44397]: debug 2024-02-19T22:24:37.006+0000 7f88c306f700 -1 osd.4 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:08.137076+0000 front 2024-02-19T22:24:08.137047+0000 (oldest deadline 2024-02-19T22:24:34.036809+0000) 2024-02-19T22:24:37.185 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:37.094+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:37.185 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:36 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:36.905+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:37.456 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:37 smithi138 systemd[1]: Stopping Ceph osd.4 for d4704266-cf70-11ee-95bb-87774f69a715... 2024-02-19T22:24:37.456 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:37 smithi138 bash[83111]: Error: no container with name or ID "ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd.4" found: no such container 2024-02-19T22:24:37.457 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:37.224+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:37.793 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4[44397]: debug 2024-02-19T22:24:37.454+0000 7f88c60f2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:24:37.793 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4[44397]: debug 2024-02-19T22:24:37.454+0000 7f88c60f2700 -1 osd.4 64 *** Got signal Terminated *** 2024-02-19T22:24:37.793 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4[44397]: debug 2024-02-19T22:24:37.454+0000 7f88c60f2700 -1 osd.4 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:24:38.131 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:37.868+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:38.131 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:37 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4[44397]: debug 2024-02-19T22:24:37.968+0000 7f88c306f700 -1 osd.4 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:08.137076+0000 front 2024-02-19T22:24:08.137047+0000 (oldest deadline 2024-02-19T22:24:34.036809+0000) 2024-02-19T22:24:38.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:38.129+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:38.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:38.271+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:39.175 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4[44397]: debug 2024-02-19T22:24:38.981+0000 7f88c306f700 -1 osd.4 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:08.137076+0000 front 2024-02-19T22:24:08.137047+0000 (oldest deadline 2024-02-19T22:24:34.036809+0000) 2024-02-19T22:24:39.175 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:38 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:38.849+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:39.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:39.173+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:39.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:39.273+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:39.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:39.273+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:40.155 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:39.885+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:40.155 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:39 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4[44397]: debug 2024-02-19T22:24:39.964+0000 7f88c306f700 -1 osd.4 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:08.137076+0000 front 2024-02-19T22:24:08.137047+0000 (oldest deadline 2024-02-19T22:24:34.036809+0000) 2024-02-19T22:24:40.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:40.152+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:40.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:40.152+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:15.193673+0000 front 2024-02-19T22:24:15.193731+0000 (oldest deadline 2024-02-19T22:24:39.893618+0000) 2024-02-19T22:24:40.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:40.232+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:40.544 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:40.232+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:41.198 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4[44397]: debug 2024-02-19T22:24:40.978+0000 7f88c306f700 -1 osd.4 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:08.137076+0000 front 2024-02-19T22:24:08.137047+0000 (oldest deadline 2024-02-19T22:24:34.036809+0000) 2024-02-19T22:24:41.199 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:40 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:40.882+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:41.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:41.196+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:41.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:41.196+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:15.193673+0000 front 2024-02-19T22:24:15.193731+0000 (oldest deadline 2024-02-19T22:24:39.893618+0000) 2024-02-19T22:24:41.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:41.250+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:41.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:41.250+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:42.190 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:41 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:41.873+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:42.190 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4[44397]: debug 2024-02-19T22:24:42.027+0000 7f88c306f700 -1 osd.4 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:08.137076+0000 front 2024-02-19T22:24:08.137047+0000 (oldest deadline 2024-02-19T22:24:34.036809+0000) 2024-02-19T22:24:42.190 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4[44397]: debug 2024-02-19T22:24:42.027+0000 7f88c306f700 -1 osd.4 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:15.137677+0000 front 2024-02-19T22:24:15.137797+0000 (oldest deadline 2024-02-19T22:24:41.037699+0000) 2024-02-19T22:24:42.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:42.188+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:42.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:42.188+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:15.193673+0000 front 2024-02-19T22:24:15.193731+0000 (oldest deadline 2024-02-19T22:24:39.893618+0000) 2024-02-19T22:24:42.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:42.293+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:42.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:42.293+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:43.187 INFO:journalctl@ceph.osd.4.smithi138.stdout:Feb 19 22:24:42 smithi138 bash[83151]: ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-4 2024-02-19T22:24:43.187 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:42 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:42.882+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:43.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:43.183+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:43.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:43.183+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:15.193673+0000 front 2024-02-19T22:24:15.193731+0000 (oldest deadline 2024-02-19T22:24:39.893618+0000) 2024-02-19T22:24:43.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:43.324+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:43.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:43.324+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:44.043 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:43.843+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:44.044 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:43 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:43.843+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:44.384 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:44.142+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:44.384 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:44.142+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:15.193673+0000 front 2024-02-19T22:24:15.193731+0000 (oldest deadline 2024-02-19T22:24:39.893618+0000) 2024-02-19T22:24:44.384 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:44.281+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:44.384 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:44.281+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:44.661 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.4.service' 2024-02-19T22:24:44.743 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:24:44.744 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-19T22:24:44.744 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-19T22:24:44.744 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.5 2024-02-19T22:24:45.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:44 smithi138 systemd[1]: Stopping Ceph osd.5 for d4704266-cf70-11ee-95bb-87774f69a715... 2024-02-19T22:24:45.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:44 smithi138 bash[83386]: Error: no container with name or ID "ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd.5" found: no such container 2024-02-19T22:24:45.044 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:44.871+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:45.044 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:44 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:44.871+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:45.504 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:45.050+0000 7f11fecf2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:24:45.504 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:45.050+0000 7f11fecf2700 -1 osd.5 64 *** Got signal Terminated *** 2024-02-19T22:24:45.504 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:45.050+0000 7f11fecf2700 -1 osd.5 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:24:45.504 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:45.111+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:45.504 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:45.111+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:15.193673+0000 front 2024-02-19T22:24:15.193731+0000 (oldest deadline 2024-02-19T22:24:39.893618+0000) 2024-02-19T22:24:45.505 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:45.231+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:45.505 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:45.231+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:46.216 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:46.131+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:46.216 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:46.131+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:15.193673+0000 front 2024-02-19T22:24:15.193731+0000 (oldest deadline 2024-02-19T22:24:39.893618+0000) 2024-02-19T22:24:46.217 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:45.905+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:46.217 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:45 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:45.905+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:46.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:46.214+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:46.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:46.214+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:47.165 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:46.893+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:47.165 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:46 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:46.893+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:47.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:47.163+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:47.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:47.163+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:15.193673+0000 front 2024-02-19T22:24:15.193731+0000 (oldest deadline 2024-02-19T22:24:39.893618+0000) 2024-02-19T22:24:47.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:47.206+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:47.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:47.206+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:48.171 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:47.867+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:48.171 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:47 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:47.867+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:48.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:48.254+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:48.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:48.254+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:48.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:48.254+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:26.163186+0000 front 2024-02-19T22:24:26.163254+0000 (oldest deadline 2024-02-19T22:24:47.263045+0000) 2024-02-19T22:24:48.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:48.169+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:48.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:48.169+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:15.193673+0000 front 2024-02-19T22:24:15.193731+0000 (oldest deadline 2024-02-19T22:24:39.893618+0000) 2024-02-19T22:24:49.228 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:49.135+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:07.791783+0000 front 2024-02-19T22:24:07.791702+0000 (oldest deadline 2024-02-19T22:24:33.592265+0000) 2024-02-19T22:24:49.228 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5[48930]: debug 2024-02-19T22:24:49.135+0000 7f11f8468700 -1 osd.5 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:15.193673+0000 front 2024-02-19T22:24:15.193731+0000 (oldest deadline 2024-02-19T22:24:39.893618+0000) 2024-02-19T22:24:49.228 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:48.893+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:49.229 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:48 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:48.893+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:49.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:49.226+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:49.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:49.226+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:49.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:49.226+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:26.163186+0000 front 2024-02-19T22:24:26.163254+0000 (oldest deadline 2024-02-19T22:24:47.263045+0000) 2024-02-19T22:24:50.238 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:49.929+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:50.238 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:49 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:49.929+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:50.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:50.235+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:50.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:50.235+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:50.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:50.235+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:26.163186+0000 front 2024-02-19T22:24:26.163254+0000 (oldest deadline 2024-02-19T22:24:47.263045+0000) 2024-02-19T22:24:50.959 INFO:journalctl@ceph.osd.5.smithi138.stdout:Feb 19 22:24:50 smithi138 bash[83427]: ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-5 2024-02-19T22:24:51.210 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:50.956+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:51.210 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:50 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:50.956+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:51.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:51.262+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:51.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:51.262+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:51.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:51.262+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:26.163186+0000 front 2024-02-19T22:24:26.163254+0000 (oldest deadline 2024-02-19T22:24:47.263045+0000) 2024-02-19T22:24:52.191 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:51.959+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:52.191 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:51.959+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:52.191 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:51 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:51.959+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:25.919819+0000 front 2024-02-19T22:24:25.919866+0000 (oldest deadline 2024-02-19T22:24:51.219745+0000) 2024-02-19T22:24:52.198 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.5.service' 2024-02-19T22:24:52.239 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:24:52.239 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-19T22:24:52.239 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-02-19T22:24:52.239 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.6 2024-02-19T22:24:52.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:52.214+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:52.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:52.214+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:52.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:52.214+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:26.163186+0000 front 2024-02-19T22:24:26.163254+0000 (oldest deadline 2024-02-19T22:24:47.263045+0000) 2024-02-19T22:24:52.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:52 smithi138 systemd[1]: Stopping Ceph osd.6 for d4704266-cf70-11ee-95bb-87774f69a715... 2024-02-19T22:24:52.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:52 smithi138 bash[83662]: Error: no container with name or ID "ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd.6" found: no such container 2024-02-19T22:24:52.919 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:52.554+0000 7fe014c3f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:24:52.919 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:52.554+0000 7fe014c3f700 -1 osd.6 64 *** Got signal Terminated *** 2024-02-19T22:24:52.919 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:52.554+0000 7fe014c3f700 -1 osd.6 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:24:53.262 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:52.917+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:53.262 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:52.917+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:53.262 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:52 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:52.917+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:25.919819+0000 front 2024-02-19T22:24:25.919866+0000 (oldest deadline 2024-02-19T22:24:51.219745+0000) 2024-02-19T22:24:53.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:53.260+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:53.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:53.260+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:53.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:53.260+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:26.163186+0000 front 2024-02-19T22:24:26.163254+0000 (oldest deadline 2024-02-19T22:24:47.263045+0000) 2024-02-19T22:24:54.283 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:53.954+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:54.283 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:53.954+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:54.283 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:53 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:53.954+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:25.919819+0000 front 2024-02-19T22:24:25.919866+0000 (oldest deadline 2024-02-19T22:24:51.219745+0000) 2024-02-19T22:24:54.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:54.281+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:54.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:54.281+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:54.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:54.281+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:26.163186+0000 front 2024-02-19T22:24:26.163254+0000 (oldest deadline 2024-02-19T22:24:47.263045+0000) 2024-02-19T22:24:55.236 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:54.922+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:55.236 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:54.922+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:55.236 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:54 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:54.922+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:25.919819+0000 front 2024-02-19T22:24:25.919866+0000 (oldest deadline 2024-02-19T22:24:51.219745+0000) 2024-02-19T22:24:55.504 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:55.234+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:55.504 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:55.234+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:55.504 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:55.234+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:26.163186+0000 front 2024-02-19T22:24:26.163254+0000 (oldest deadline 2024-02-19T22:24:47.263045+0000) 2024-02-19T22:24:56.195 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:55.920+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:56.195 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:55.920+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:56.195 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:55 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:55.920+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:25.919819+0000 front 2024-02-19T22:24:25.919866+0000 (oldest deadline 2024-02-19T22:24:51.219745+0000) 2024-02-19T22:24:56.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:56.193+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:56.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:56.193+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:56.543 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:56.193+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:26.163186+0000 front 2024-02-19T22:24:26.163254+0000 (oldest deadline 2024-02-19T22:24:47.263045+0000) 2024-02-19T22:24:57.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:56.926+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:57.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:56.926+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:57.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:56 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:56.926+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:25.919819+0000 front 2024-02-19T22:24:25.919866+0000 (oldest deadline 2024-02-19T22:24:51.219745+0000) 2024-02-19T22:24:57.293 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:57.159+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:11.160373+0000 front 2024-02-19T22:24:11.160448+0000 (oldest deadline 2024-02-19T22:24:34.060202+0000) 2024-02-19T22:24:57.293 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:57.159+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.761131+0000 front 2024-02-19T22:24:18.761197+0000 (oldest deadline 2024-02-19T22:24:39.261088+0000) 2024-02-19T22:24:57.293 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:57.159+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:26.163186+0000 front 2024-02-19T22:24:26.163254+0000 (oldest deadline 2024-02-19T22:24:47.263045+0000) 2024-02-19T22:24:57.293 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6[53715]: debug 2024-02-19T22:24:57.159+0000 7fe011bbc700 -1 osd.6 64 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-02-19T22:24:32.365029+0000 front 2024-02-19T22:24:32.365046+0000 (oldest deadline 2024-02-19T22:24:56.464988+0000) 2024-02-19T22:24:58.293 INFO:journalctl@ceph.osd.6.smithi138.stdout:Feb 19 22:24:58 smithi138 bash[83703]: ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-6 2024-02-19T22:24:58.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:57.880+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:58.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:57.880+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:58.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:57 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:57.880+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:25.919819+0000 front 2024-02-19T22:24:25.919866+0000 (oldest deadline 2024-02-19T22:24:51.219745+0000) 2024-02-19T22:24:59.043 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:58.855+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:24:59.043 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:58.855+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:24:59.043 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:58 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:58.855+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:25.919819+0000 front 2024-02-19T22:24:25.919866+0000 (oldest deadline 2024-02-19T22:24:51.219745+0000) 2024-02-19T22:24:59.661 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.6.service' 2024-02-19T22:24:59.702 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:24:59.703 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-02-19T22:24:59.703 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-02-19T22:24:59.703 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.7 2024-02-19T22:25:00.018 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:59 smithi138 systemd[1]: Stopping Ceph osd.7 for d4704266-cf70-11ee-95bb-87774f69a715... 2024-02-19T22:25:00.018 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:59 smithi138 bash[83938]: Error: no container with name or ID "ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd.7" found: no such container 2024-02-19T22:25:00.018 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:59.857+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:25:00.019 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:59.857+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:25:00.019 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:59.857+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:25.919819+0000 front 2024-02-19T22:24:25.919866+0000 (oldest deadline 2024-02-19T22:24:51.219745+0000) 2024-02-19T22:25:00.019 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:24:59 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:24:59.857+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-02-19T22:24:34.120941+0000 front 2024-02-19T22:24:34.120949+0000 (oldest deadline 2024-02-19T22:24:59.420875+0000) 2024-02-19T22:25:00.019 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:00.015+0000 7f042574c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-19T22:25:00.019 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:00.015+0000 7f042574c700 -1 osd.7 64 *** Got signal Terminated *** 2024-02-19T22:25:00.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:00.015+0000 7f042574c700 -1 osd.7 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T22:25:01.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:00.882+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:25:01.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:00.882+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:25:01.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:00.882+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:25.919819+0000 front 2024-02-19T22:24:25.919866+0000 (oldest deadline 2024-02-19T22:24:51.219745+0000) 2024-02-19T22:25:01.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:00 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:00.882+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-02-19T22:24:34.120941+0000 front 2024-02-19T22:24:34.120949+0000 (oldest deadline 2024-02-19T22:24:59.420875+0000) 2024-02-19T22:25:02.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:01.875+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:25:02.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:01.875+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:25:02.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:01.875+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:25.919819+0000 front 2024-02-19T22:24:25.919866+0000 (oldest deadline 2024-02-19T22:24:51.219745+0000) 2024-02-19T22:25:02.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:01 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:01.875+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-02-19T22:24:34.120941+0000 front 2024-02-19T22:24:34.120949+0000 (oldest deadline 2024-02-19T22:24:59.420875+0000) 2024-02-19T22:25:03.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:02.835+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:25:03.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:02.835+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:25:03.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:02.835+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:25.919819+0000 front 2024-02-19T22:24:25.919866+0000 (oldest deadline 2024-02-19T22:24:51.219745+0000) 2024-02-19T22:25:03.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:02 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:02.835+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-02-19T22:24:34.120941+0000 front 2024-02-19T22:24:34.120949+0000 (oldest deadline 2024-02-19T22:24:59.420875+0000) 2024-02-19T22:25:04.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:03.881+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:25:04.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:03.881+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:25:04.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:03.881+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:25.919819+0000 front 2024-02-19T22:24:25.919866+0000 (oldest deadline 2024-02-19T22:24:51.219745+0000) 2024-02-19T22:25:04.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:03 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:03.881+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-02-19T22:24:34.120941+0000 front 2024-02-19T22:24:34.120949+0000 (oldest deadline 2024-02-19T22:24:59.420875+0000) 2024-02-19T22:25:05.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:04.909+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-02-19T22:24:10.817326+0000 front 2024-02-19T22:24:10.817382+0000 (oldest deadline 2024-02-19T22:24:33.117260+0000) 2024-02-19T22:25:05.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:04.909+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-02-19T22:24:18.418272+0000 front 2024-02-19T22:24:18.418249+0000 (oldest deadline 2024-02-19T22:24:43.118115+0000) 2024-02-19T22:25:05.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:04.909+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-02-19T22:24:25.919819+0000 front 2024-02-19T22:24:25.919866+0000 (oldest deadline 2024-02-19T22:24:51.219745+0000) 2024-02-19T22:25:05.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:04.909+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-02-19T22:24:34.120941+0000 front 2024-02-19T22:24:34.120949+0000 (oldest deadline 2024-02-19T22:24:59.420875+0000) 2024-02-19T22:25:05.293 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:04 smithi138 ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7[58325]: debug 2024-02-19T22:25:04.909+0000 7f041eec2700 -1 osd.7 64 heartbeat_check: no reply from 172.21.15.138:6804 osd.4 since back 2024-02-19T22:24:39.421396+0000 front 2024-02-19T22:24:39.421307+0000 (oldest deadline 2024-02-19T22:25:04.721320+0000) 2024-02-19T22:25:05.793 INFO:journalctl@ceph.osd.7.smithi138.stdout:Feb 19 22:25:05 smithi138 bash[83978]: ceph-d4704266-cf70-11ee-95bb-87774f69a715-osd-7 2024-02-19T22:25:07.204 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d4704266-cf70-11ee-95bb-87774f69a715@osd.7.service' 2024-02-19T22:25:07.245 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T22:25:07.245 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-02-19T22:25:07.245 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d4704266-cf70-11ee-95bb-87774f69a715 --force --keep-logs 2024-02-19T22:25:29.133 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d4704266-cf70-11ee-95bb-87774f69a715 --force --keep-logs 2024-02-19T22:25:42.316 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T22:25:42.354 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T22:25:42.384 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-19T22:25:42.386 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi/7566784/remote/ubuntu@smithi099.front.sepia.ceph.com/crash 2024-02-19T22:25:42.387 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/crash -- . 2024-02-19T22:25:42.432 INFO:teuthology.orchestra.run.smithi099.stderr:tar: /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/crash: Cannot open: No such file or directory 2024-02-19T22:25:42.432 INFO:teuthology.orchestra.run.smithi099.stderr:tar: Error is not recoverable: exiting now 2024-02-19T22:25:42.434 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi/7566784/remote/ubuntu@smithi138.front.sepia.ceph.com/crash 2024-02-19T22:25:42.435 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/crash -- . 2024-02-19T22:25:42.482 INFO:teuthology.orchestra.run.smithi138.stderr:tar: /var/lib/ceph/d4704266-cf70-11ee-95bb-87774f69a715/crash: Cannot open: No such file or directory 2024-02-19T22:25:42.482 INFO:teuthology.orchestra.run.smithi138.stderr:tar: Error is not recoverable: exiting now 2024-02-19T22:25:42.483 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-19T22:25:42.483 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-02-19T22:25:42.514 INFO:teuthology.orchestra.run.smithi099.stdout:2024-02-19T21:58:47.903693+0000 mon.smithi099 (mon.0) 641 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-19T22:25:42.515 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-19T22:25:42.515 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[SEC\]' /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-02-19T22:25:42.585 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[ERR\]' /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-02-19T22:25:42.654 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[WRN\]' /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-02-19T22:25:42.723 INFO:teuthology.orchestra.run.smithi099.stdout:2024-02-19T21:58:47.903693+0000 mon.smithi099 (mon.0) 641 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-19T22:25:42.723 INFO:tasks.cephadm:Compressing logs... 2024-02-19T22:25:42.723 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-19T22:25:42.766 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-19T22:25:42.791 INFO:teuthology.orchestra.run.smithi099.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-19T22:25:42.791 INFO:teuthology.orchestra.run.smithi099.stderr:: No such file or directory 2024-02-19T22:25:42.791 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-volume.log 2024-02-19T22:25:42.791 INFO:teuthology.orchestra.run.smithi099.stderr:gzip /var/log/ceph/cephadm.log: -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.2.log 2024-02-19T22:25:42.791 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mds.foo.smithi099.berqpt.log 2024-02-19T22:25:42.791 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mon.smithi099.log 2024-02-19T22:25:42.792 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mds.foo.smithi099.berqpt.log: gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.audit.log 2024-02-19T22:25:42.793 INFO:teuthology.orchestra.run.smithi138.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-19T22:25:42.793 INFO:teuthology.orchestra.run.smithi138.stderr:: No such file or directory 2024-02-19T22:25:42.793 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.6.log 2024-02-19T22:25:42.793 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-volume.log 2024-02-19T22:25:42.795 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.audit.log 2024-02-19T22:25:42.795 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.6.log: /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.cephadm.log 2024-02-19T22:25:42.795 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mds.foo.smithi138.lynaor.log 2024-02-19T22:25:42.795 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.cephadm.log: 83.4% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.cephadm.log.gz 2024-02-19T22:25:42.795 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mds.foo.smithi138.lynaor.log: 82.2% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mds.foo.smithi138.lynaor.log.gz 2024-02-19T22:25:42.795 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.7.log 2024-02-19T22:25:42.796 INFO:teuthology.orchestra.run.smithi138.stderr: 91.4% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.audit.log.gz 2024-02-19T22:25:42.796 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mgr.smithi138.yvypfr.log 2024-02-19T22:25:42.796 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mon.smithi138.log 2024-02-19T22:25:42.799 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.7.log: /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mgr.smithi138.yvypfr.log: /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mon.smithi138.log: 91.8% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-volume.log.gz 2024-02-19T22:25:42.799 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.log 2024-02-19T22:25:42.799 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.4.log 2024-02-19T22:25:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mon.smithi099.log: gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.cephadm.log 2024-02-19T22:25:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.audit.log: /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.cephadm.log: 86.6% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mds.foo.smithi099.berqpt.log.gz 2024-02-19T22:25:42.802 INFO:teuthology.orchestra.run.smithi099.stderr: 83.8% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.cephadm.log.gz 2024-02-19T22:25:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.3.log 2024-02-19T22:25:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.0.log 2024-02-19T22:25:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.3.log: /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.0.log: 91.2% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.audit.log.gz 2024-02-19T22:25:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mgr.smithi099.zfglya.log 2024-02-19T22:25:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mgr.smithi099.zfglya.log: 91.9% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-volume.log.gz 2024-02-19T22:25:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.log 2024-02-19T22:25:42.802 INFO:teuthology.orchestra.run.smithi099.stderr: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-19T22:25:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mds.bar.smithi099.pyaktn.log 2024-02-19T22:25:42.804 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.log: /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mds.bar.smithi099.pyaktn.log: gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.1.log 2024-02-19T22:25:42.804 INFO:teuthology.orchestra.run.smithi099.stderr: 79.6% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mds.bar.smithi099.pyaktn.log.gz 2024-02-19T22:25:42.805 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-02-19T22:25:42.805 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.log: 31.5% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-02-19T22:25:42.805 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.log: /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.4.log: 90.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-19T22:25:42.805 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.log.gz 2024-02-19T22:25:42.805 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mds.bar.smithi138.ibobdc.log 2024-02-19T22:25:42.805 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.5.log 2024-02-19T22:25:42.805 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mds.bar.smithi138.ibobdc.log: 59.7% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mds.bar.smithi138.ibobdc.log.gz 2024-02-19T22:25:42.805 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph.log.gz 2024-02-19T22:25:42.806 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.5.log: 93.2% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mgr.smithi138.yvypfr.log.gz 2024-02-19T22:25:42.806 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-02-19T22:25:42.807 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.1.log: 31.5% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-02-19T22:25:43.099 INFO:teuthology.orchestra.run.smithi099.stderr: 90.1% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mgr.smithi099.zfglya.log.gz 2024-02-19T22:25:43.923 INFO:teuthology.orchestra.run.smithi099.stderr: 90.1% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mon.smithi099.log.gz 2024-02-19T22:25:44.535 INFO:teuthology.orchestra.run.smithi138.stderr: 93.7% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-mon.smithi138.log.gz 2024-02-19T22:26:00.500 INFO:teuthology.orchestra.run.smithi138.stderr: 93.9% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.6.log.gz 2024-02-19T22:26:01.607 INFO:teuthology.orchestra.run.smithi099.stderr: 93.7% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.2.log.gz 2024-02-19T22:26:02.655 INFO:teuthology.orchestra.run.smithi138.stderr: 93.5% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.7.log.gz 2024-02-19T22:26:04.455 INFO:teuthology.orchestra.run.smithi138.stderr: 93.5% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.5.log.gz 2024-02-19T22:26:05.497 INFO:teuthology.orchestra.run.smithi099.stderr: 93.8% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.0.log.gz 2024-02-19T22:26:09.499 INFO:teuthology.orchestra.run.smithi099.stderr: 93.8% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.1.log.gz 2024-02-19T22:26:10.767 INFO:teuthology.orchestra.run.smithi099.stderr: 94.0% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.3.log.gz 2024-02-19T22:26:10.769 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-19T22:26:10.769 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m27.988s 2024-02-19T22:26:10.769 INFO:teuthology.orchestra.run.smithi099.stderr:user 1m33.610s 2024-02-19T22:26:10.769 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m3.715s 2024-02-19T22:26:16.935 INFO:teuthology.orchestra.run.smithi138.stderr: 93.9% -- replaced with /var/log/ceph/d4704266-cf70-11ee-95bb-87774f69a715/ceph-osd.4.log.gz 2024-02-19T22:26:16.937 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-02-19T22:26:16.937 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m34.154s 2024-02-19T22:26:16.937 INFO:teuthology.orchestra.run.smithi138.stderr:user 1m31.319s 2024-02-19T22:26:16.937 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m3.649s 2024-02-19T22:26:16.937 INFO:tasks.cephadm:Archiving logs... 2024-02-19T22:26:16.938 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi/7566784/remote/ubuntu@smithi099.front.sepia.ceph.com/log 2024-02-19T22:26:16.939 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-19T22:26:31.075 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi/7566784/remote/ubuntu@smithi138.front.sepia.ceph.com/log 2024-02-19T22:26:31.076 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-19T22:26:45.077 INFO:tasks.cephadm:Removing cluster... 2024-02-19T22:26:45.077 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d4704266-cf70-11ee-95bb-87774f69a715 --force 2024-02-19T22:26:45.655 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d4704266-cf70-11ee-95bb-87774f69a715 --force 2024-02-19T22:26:46.238 INFO:tasks.cephadm:Removing cephadm ... 2024-02-19T22:26:46.239 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-19T22:26:46.260 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-19T22:26:46.279 INFO:tasks.cephadm:Teardown complete 2024-02-19T22:26:46.279 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-19T22:26:46.289 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-19T22:26:46.290 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-19T22:26:46.303 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-19T22:26:46.415 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-19T22:26:46.425 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-19T22:26:46.425 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T22:26:46.427 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T22:26:46.443 INFO:teuthology.orchestra.run.smithi099.stderr:bash: ntpq: command not found 2024-02-19T22:26:46.444 INFO:teuthology.orchestra.run.smithi138.stderr:bash: ntpq: command not found 2024-02-19T22:26:46.448 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T22:26:46.448 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-02-19T22:26:46.448 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 64 +1892us[+1882us] +/- 104ms 2024-02-19T22:26:46.448 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv02.front.sepia.ceph.com 3 6 377 61 -1600us[-1609us] +/- 57ms 2024-02-19T22:26:46.448 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +972us[ +962us] +/- 90ms 2024-02-19T22:26:46.448 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T22:26:46.450 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T22:26:46.450 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-02-19T22:26:46.450 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 64 +1892us[+1896us] +/- 104ms 2024-02-19T22:26:46.450 INFO:teuthology.orchestra.run.smithi138.stdout:^* hv02.front.sepia.ceph.com 3 6 377 63 -1594us[-1590us] +/- 57ms 2024-02-19T22:26:46.450 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +977us[ +977us] +/- 90ms 2024-02-19T22:26:46.450 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T22:26:46.450 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-19T22:26:46.460 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-19T22:26:46.460 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-19T22:26:46.471 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-19T22:26:46.558 DEBUG:teuthology.orchestra.run.smithi138:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-19T22:26:46.619 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T22:26:46.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T22:26:46.650 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T22:26:46.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T22:26:46.679 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-19T22:26:46.689 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-19T22:26:46.699 INFO:teuthology.task.internal:Duration was 2888.266854 seconds 2024-02-19T22:26:46.699 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-19T22:26:46.709 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-19T22:26:46.709 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-19T22:26:46.711 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-19T22:26:46.755 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T22:26:46.765 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T22:26:46.963 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-19T22:26:46.963 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-02-19T22:26:46.964 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-19T22:26:46.986 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-02-19T22:26:46.986 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-19T22:26:47.008 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-19T22:26:47.008 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-19T22:26:47.029 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-19T22:26:47.100 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-19T22:26:47.100 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-19T22:26:47.102 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-19T22:26:47.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-19T22:26:47.220 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-19T22:26:47.220 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-19T22:26:47.247 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-19T22:26:47.274 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-19T22:26:47.286 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-19T22:26:47.290 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-19T22:26:47.314 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-02-19T22:26:47.340 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-02-19T22:26:47.353 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-19T22:26:47.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T22:26:47.384 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-19T22:26:47.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T22:26:47.410 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-19T22:26:47.421 INFO:teuthology.task.internal:Transferring archived files... 2024-02-19T22:26:47.422 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi/7566784/remote/smithi099 2024-02-19T22:26:47.423 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-19T22:26:47.467 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi/7566784/remote/smithi138 2024-02-19T22:26:47.468 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-19T22:26:47.507 INFO:teuthology.task.internal:Removing archive directory... 2024-02-19T22:26:47.507 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-19T22:26:47.509 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-19T22:26:47.559 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-19T22:26:47.572 INFO:teuthology.task.internal:Not uploading archives. 2024-02-19T22:26:47.572 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-19T22:26:47.583 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-19T22:26:47.583 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-19T22:26:47.585 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-19T22:26:47.600 INFO:teuthology.orchestra.run.smithi099.stdout: 525694 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 19 22:26 /home/ubuntu/cephtest 2024-02-19T22:26:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: 525918 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 19 22:26 /home/ubuntu/cephtest 2024-02-19T22:26:47.617 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-19T22:26:47.629 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-19T22:26:47.733 INFO:teuthology.nuke:Checking targets against current locks 2024-02-19T22:26:47.765 DEBUG:teuthology.nuke:shortname: smithi099 2024-02-19T22:26:47.766 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-19T22:26:47.804 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi/7566784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 21:30:35.563985', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGxv3unWLzaPNAWxEEb71WIhMAQSIVJXpgmmLE/SY2J9Nw9Ht1UO7kv5Nsg9ECCWd31MZo10hhL07xRd4QMIdbs='} 2024-02-19T22:26:47.817 DEBUG:teuthology.nuke:shortname: smithi138 2024-02-19T22:26:47.820 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-19T22:26:47.849 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi/7566784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 21:30:35.562533', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFygB8ONx/qD4OYEDspSOMoLbhEmXaLetNhgh3HA810oWq9V2OZo+5ITjZY/bwkSh64S4dxPAYCaE4sIwPgoslc='} 2024-02-19T22:26:47.896 INFO:teuthology.orchestra.console.smithi099:Power off 2024-02-19T22:26:47.896 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T22:26:47.940 INFO:teuthology.orchestra.console.smithi138:Power off 2024-02-19T22:26:47.941 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T22:26:47.951 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-02-19T22:26:47.951 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T22:26:47.989 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2024-02-19T22:26:47.990 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T22:26:48.002 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-19T22:26:48.038 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-02-19T22:26:52.004 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T22:26:52.039 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T22:26:52.117 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-19T22:26:52.149 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-02-19T22:26:56.120 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T22:26:56.149 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T22:26:56.231 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-19T22:26:56.260 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-02-19T22:26:56.332 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-02-19T22:26:56.361 INFO:teuthology.orchestra.console.smithi138:Power off completed 2024-02-19T22:26:56.465 INFO:teuthology.run:Summary data: description: fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/centos_latest} duration: 2888.2668538093567 failure_reason: '"2024-02-19T21:58:47.903693+0000 mon.smithi099 (mon.0) 641 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2024-02-19T22:26:56.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T22:26:56.556 INFO:teuthology.run:FAIL